-- Logs begin at Tue 2021-11-09 09:39:17 UTC, end at Tue 2021-11-09 10:54:28 UTC. -- Nov 09 10:26:25.232603 dv-cinder-816628-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 10:26:25.241104 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 10:26:25 2021] *** Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: nodename: dv-cinder-816628-1-iscsi Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: machine: x86_64 Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: clock source: unix Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: pcre jit disabled Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: detected number of CPU cores: 4 Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: current working directory: / Nov 09 10:26:25.242811 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: detected binary path: /usr/bin/uwsgi-core Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: your processes number limit is 47680 Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: your memory page size is 4096 bytes Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: detected max file descriptor number: 2048 Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: lock engine: pthread robust mutexes Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: thunder lock: enabled Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 10:26:25.243385 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 10:26:25.288601 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: Python main interpreter initialized at 0x55f6f0ca49c0 Nov 09 10:26:25.288601 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: python threads support enabled Nov 09 10:26:25.288601 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: your server socket listen backlog is limited to 100 connections Nov 09 10:26:25.288601 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: your mercy for graceful operations on workers is 90 seconds Nov 09 10:26:25.288990 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 10:26:25.289085 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: *** Operational MODE: preforking *** Nov 09 10:26:25.289318 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: *** uWSGI is running in multiple interpreter mode *** Nov 09 10:26:25.289318 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: spawned uWSGI master process (pid: 101210) Nov 09 10:26:25.289534 dv-cinder-816628-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 10:26:25.290116 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: spawned uWSGI worker 1 (pid: 101211, cores: 1) Nov 09 10:26:25.290451 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: spawned uWSGI worker 2 (pid: 101212, cores: 1) Nov 09 10:26:25.292056 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 10:26:26.955556 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:26:26.955556 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: from cryptography.utils import int_from_bytes Nov 09 10:26:26.956316 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:26:26.956316 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: from cryptography.utils import int_from_bytes Nov 09 10:26:26.956758 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:26:26.956758 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: from cryptography.utils import int_from_bytes Nov 09 10:26:26.956871 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:26:26.956871 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: from cryptography.utils import int_from_bytes Nov 09 10:26:29.589020 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 10:26:29.589588 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 10:26:29.589752 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 10:26:29.590108 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 10:26:29.590357 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 10:26:29.590747 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.590937 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 10:26:29.591303 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.591393 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 10:26:29.591471 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.591682 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.591777 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 10:26:29.592033 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.592138 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 10:26:29.592325 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 10:26:29.592450 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.592648 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.592764 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.592965 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593060 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593289 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593401 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593549 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593707 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.593855 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594024 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816628-1-iscsi {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594337 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594491 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594643 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594789 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.594963 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595112 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595292 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595395 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595554 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595703 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.595869 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.596042 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.596227 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816628-1-iscsi {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.596332 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.596550 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.596797 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597258 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597258 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597409 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597481 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597551 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597751 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.597843 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.598072 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.598281 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.598513 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.598717 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.598717 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.599125 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.599347 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.599601 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.599813 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.600076 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.600285 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.600517 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.600717 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.600945 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.601147 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816628-1-iscsi {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.601341 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.601594 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.601824 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.602025 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.602220 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.602447 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.602626 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.602873 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.603026 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.603206 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.603345 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.603516 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.603671 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816628-1-iscsi {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604442 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604522 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604586 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604666 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604750 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604822 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604887 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.604958 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605029 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605094 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605163 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605233 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605297 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605373 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605445 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605516 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605581 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.605918 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606078 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606227 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606364 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606500 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606635 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606770 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.606916 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.607064 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.607199 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.607343 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.607699 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.607848 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608101 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608245 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608467 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608610 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608758 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.608910 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609049 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609234 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609388 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609531 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609676 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609826 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.609966 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610101 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610268 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610410 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610556 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610692 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610827 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.610978 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611114 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611114 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611388 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611388 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611665 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611809 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.611952 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612141 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612277 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612412 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612546 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612691 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612827 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.612971 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613114 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613251 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613394 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613536 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613679 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613824 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.613960 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614096 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614237 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614380 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614525 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614673 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614810 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.614944 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615078 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615213 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615356 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615499 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615636 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615778 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.615915 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616086 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616238 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616384 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616519 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616660 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616796 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.616968 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617113 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617267 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617403 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617561 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617731 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.617940 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618091 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618244 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618382 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618516 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618650 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618784 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.618927 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619071 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619212 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619404 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619543 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619693 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.619829 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620024 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620189 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620334 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620471 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620619 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620755 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.620898 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621034 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621179 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621322 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621490 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621631 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621773 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.621909 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622053 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622189 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622332 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622468 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622604 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622739 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.622873 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623016 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623158 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623301 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623437 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623573 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623707 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.623885 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624061 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624200 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624335 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624511 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624655 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624802 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.624938 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625102 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625245 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625489 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625630 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625774 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.625926 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626063 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626198 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626332 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626467 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626610 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626747 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.626883 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627030 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627313 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627461 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627613 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627762 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.627904 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628105 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628253 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628402 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628549 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628692 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628835 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.628972 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629114 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629258 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629394 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629543 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629679 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629821 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.629967 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630103 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630238 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630372 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630532 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630674 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630825 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.630971 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631131 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631280 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631430 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631566 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631709 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.631845 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632034 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632178 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632370 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632527 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632679 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.632843 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.632994 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.633174 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.633317 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.633540 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.633685 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.633827 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.633970 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.634113 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.634252 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.634433 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.634878 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.635040 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.635178 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.635338 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:26:29.635481 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.635640 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.635776 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.635987 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636136 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636300 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636442 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636613 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636778 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.636948 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637092 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637268 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637420 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637587 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637751 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.637887 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638020 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638202 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638354 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638523 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638665 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638836 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.638982 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639148 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639354 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639508 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639656 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639792 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.639927 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640140 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640287 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640426 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640561 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640740 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.640883 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641057 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641212 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641374 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641522 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641669 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641803 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.641990 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642140 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642312 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642463 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642628 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642770 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.642938 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643079 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643249 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643391 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643581 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643735 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.643885 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644060 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644203 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644339 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644539 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644688 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644837 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.644972 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645153 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645295 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645459 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645620 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645766 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.645908 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646051 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646187 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646351 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646513 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646651 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646786 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.646962 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647105 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647289 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647449 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647606 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647744 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.647910 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648109 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648247 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648393 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648530 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648665 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648829 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.648979 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649115 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649258 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649429 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649580 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649739 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.649890 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.650035 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.650179 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.650353 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.650496 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.651241 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.651383 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.651554 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.651704 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.651869 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652072 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652235 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652373 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652522 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.652845 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653015 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653158 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653331 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653483 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653649 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653791 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.653965 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654125 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654298 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654440 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654604 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654747 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.654909 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655052 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655222 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655365 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655533 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655675 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.655844 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656020 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656186 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656338 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656514 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656656 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656832 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.656989 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.657299 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.657449 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.657586 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.657720 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.657859 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658012 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658150 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658296 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658431 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658566 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658700 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658842 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.658977 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659112 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659256 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659399 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659535 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659679 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.659821 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660005 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660162 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660299 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660434 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660581 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660717 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660851 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.660992 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661128 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661275 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661412 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661548 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661682 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.661860 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662003 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662168 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662318 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662509 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662658 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662817 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.662965 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663109 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663246 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663418 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663567 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663710 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.663864 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664043 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664187 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664328 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664472 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664667 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664818 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.664962 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665096 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665276 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665418 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665596 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665748 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.665893 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.666036 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.666275 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.666900 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667086 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667238 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667404 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667554 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667722 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.667869 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668068 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668229 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668367 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668510 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668646 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668781 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.668987 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669142 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669311 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669452 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669624 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669766 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.669932 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670080 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670223 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670357 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670545 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670688 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.670854 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671088 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671236 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671372 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671506 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671641 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671827 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.671991 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672135 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672269 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672404 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672548 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672832 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.672966 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673110 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673289 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673447 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673605 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673753 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.673903 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.674044 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.674204 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.674873 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675028 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675180 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675323 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675464 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675620 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675779 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.675921 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676136 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676280 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676432 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676575 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676726 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.676917 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677074 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677217 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677358 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677499 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677655 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677797 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.677939 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678081 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678221 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678386 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678530 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678671 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678822 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.678970 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.679121 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.679846 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680024 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680182 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680333 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680476 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680626 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680768 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.680909 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681050 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681202 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681344 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681494 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681637 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681801 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.681958 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682101 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682250 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682393 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682534 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682682 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682826 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.682967 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683127 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683296 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683440 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683581 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683721 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.683868 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684052 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684202 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684355 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684498 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684640 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684781 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.684936 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685092 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685234 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685382 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685525 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685674 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.685816 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686039 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686185 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686326 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686468 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686690 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686836 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.686987 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687128 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687268 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687408 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687559 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687702 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.687842 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688008 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688157 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688319 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688471 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688615 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688756 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.688906 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689047 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689239 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689392 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689542 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689684 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.689901 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690060 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690213 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690355 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690511 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690667 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690809 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.690961 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691111 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691253 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691393 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691533 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691681 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.691823 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692023 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692173 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692314 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692456 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692456 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692739 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.692892 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693033 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693173 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693314 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693456 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693606 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693749 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.693918 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694067 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694208 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694208 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694485 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694645 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694787 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.694935 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695077 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695217 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695370 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695512 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695659 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695808 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.695950 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696129 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696272 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696412 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696412 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696688 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696835 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.696986 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697129 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697270 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697433 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697588 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697730 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697908 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.697908 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698216 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698369 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698524 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698674 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698825 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.698976 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699125 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699266 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699407 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699563 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699705 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.699855 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700054 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700205 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700347 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700347 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700637 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700791 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.700935 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701085 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701238 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701238 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701506 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701663 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701815 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.701958 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702108 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702283 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702427 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702577 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702720 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.702868 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703017 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703159 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703301 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703451 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703593 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703734 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.703875 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704034 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704191 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704191 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704478 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704626 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704768 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.704915 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705069 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705220 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705364 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705505 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705646 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705786 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.705936 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706088 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706237 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706379 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706519 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706659 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706809 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.706952 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707093 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707234 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707375 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707515 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707664 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.707823 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708008 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708157 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708317 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708461 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708611 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708752 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.708894 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709034 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709175 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709393 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709539 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709687 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709838 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.709979 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710126 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710276 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710426 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710568 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710709 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710850 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.710991 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711141 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711290 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711432 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711573 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711723 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.711864 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712033 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712189 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712331 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712472 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712612 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712763 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.712904 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.713568 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.713756 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.713925 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714068 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714231 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714374 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714515 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714656 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714796 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.714937 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715086 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715227 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715368 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715537 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715682 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715823 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.715992 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716153 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716305 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716448 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716589 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716738 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.716889 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717031 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717171 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717312 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717452 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717606 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717749 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.717900 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718043 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718192 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718335 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718489 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718644 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718790 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.718931 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719072 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719220 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719371 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719512 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719652 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719803 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.719951 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720146 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720289 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720430 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720570 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720731 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.720926 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721090 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721233 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721375 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721523 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721666 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721818 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.721968 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722111 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722254 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722395 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722595 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722742 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.722897 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723039 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723181 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723329 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723470 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723620 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723775 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.723917 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724085 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724184 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724269 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724372 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724372 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724526 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724605 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724682 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724758 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724843 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.724922 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725014 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725099 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725177 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725349 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725450 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725671 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725767 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.725986 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.726071 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.726295 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.726579 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.726579 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.726872 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727017 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727158 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727309 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727453 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727602 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727794 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.727944 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728143 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728299 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728478 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728675 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728851 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.728851 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729131 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729281 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729423 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729566 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729714 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.729916 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.730066 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.730278 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.730476 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.730626 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.730888 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.731035 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.731197 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.731496 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.731644 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.731808 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.732138 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.732291 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.732513 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.732781 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.732930 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.734432 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.734624 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.734776 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.734776 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735128 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735271 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735414 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735564 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735708 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.735860 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736068 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736219 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736219 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.736500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.738875 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739025 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739184 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739335 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739479 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739673 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.739925 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.740221 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.740443 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.740594 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.740739 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.740919 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741071 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741214 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741434 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741587 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741730 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741872 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.741872 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.742309 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.742568 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.742831 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.742831 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.743176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.743176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.743487 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.744184 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.745148 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.745310 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.745532 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.745692 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.745887 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746033 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746175 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746317 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746459 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746459 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746749 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.746894 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747034 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747175 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747324 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747475 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747619 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747761 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747903 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.747903 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748214 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748366 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748520 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748662 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748803 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748944 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.748944 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749220 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749364 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749506 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749646 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749786 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.749927 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750082 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750226 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750384 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750527 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750675 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750830 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.750973 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751115 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751256 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751398 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751541 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751692 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.751835 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752036 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752188 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752341 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752494 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752494 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752776 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.752919 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753088 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753233 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753384 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753536 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753680 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753822 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.753985 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754152 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754295 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754295 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754564 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754723 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.754871 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755037 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755181 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755322 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755477 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755627 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755772 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.755914 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756097 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756252 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756404 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756548 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756689 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.756832 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757004 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757148 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757301 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757444 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757586 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757728 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.757870 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758021 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758172 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758315 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758466 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758610 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758751 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.758921 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.759066 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.759214 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.759364 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.759761 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.759928 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760157 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760313 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760455 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760603 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760746 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.760746 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761024 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761191 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761335 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761477 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761627 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761769 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.761923 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762084 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762227 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762227 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762496 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762651 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762795 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.762938 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763105 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763269 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763423 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763575 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763719 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.763868 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764046 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764196 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764348 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764500 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764651 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764804 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.764947 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765099 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765242 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765393 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765536 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765536 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765812 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.765971 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766123 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766267 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766408 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766550 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766698 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766841 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.766995 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767140 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767282 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767436 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767580 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767731 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.767887 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768069 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768215 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768359 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768501 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768688 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768848 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.768992 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769134 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769276 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769418 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769569 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769730 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.769879 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770022 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770170 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770312 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770463 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770606 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770748 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.770910 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771124 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771272 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771424 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771574 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771727 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.771917 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772109 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772211 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772318 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772406 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772488 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772567 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772646 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772735 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772816 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772895 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.772982 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773070 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773150 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773238 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773319 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773398 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773477 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773555 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773634 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773722 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773826 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773916 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.773997 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774082 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774082 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774235 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774316 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774394 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774473 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774551 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774639 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774720 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774799 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774885 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.774973 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775054 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775142 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775222 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775222 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775370 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775451 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775536 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775625 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775738 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.775904 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776076 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776266 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776395 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776591 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776712 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.776918 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777028 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777252 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777363 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777567 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777664 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777882 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.777969 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778195 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778345 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778510 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778597 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778841 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.778935 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779173 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779262 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779479 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779565 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779792 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.779887 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780136 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780226 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780456 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780556 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780770 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.780876 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781080 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781167 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781393 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781487 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781711 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.781811 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782020 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782107 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782344 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782441 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782631 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782728 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.782942 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783031 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783268 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783354 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783568 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783656 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.783882 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784010 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784224 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784318 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784534 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784622 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784845 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.784933 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.785161 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.785358 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.785536 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.785672 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.785812 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786003 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786132 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786326 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786444 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786673 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786766 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.786995 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.787102 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.787309 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.787564 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.787726 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.787880 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788047 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788222 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788386 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788547 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788690 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788832 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.788972 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789135 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789295 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789446 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789589 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789737 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.789880 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790117 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790271 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790452 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790596 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790739 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.790882 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.791037 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.791701 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.791852 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792028 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792179 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792345 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792505 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792672 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792822 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.792997 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.793155 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.793298 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.793492 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.793637 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.793903 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794065 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794212 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794362 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794506 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794648 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794790 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.794938 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795092 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795243 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795386 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795529 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795671 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.795838 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796011 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796173 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796317 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796459 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796601 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796743 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.796906 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797050 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797192 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797344 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797497 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797665 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797819 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.797969 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798112 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798254 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798396 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798537 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798690 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.798853 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799004 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799147 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799290 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799431 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799582 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799727 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.799870 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800030 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800178 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800321 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800479 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800623 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800782 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.800926 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801069 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801224 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801368 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801510 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801652 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801801 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.801943 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802094 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802243 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802386 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802528 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802680 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802824 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.802988 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803171 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803323 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803467 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803609 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803751 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.803903 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804074 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804218 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804360 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804502 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804666 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804817 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.804962 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805104 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805246 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805395 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805547 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805688 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.805838 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.806035 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.806187 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.806355 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.806523 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.806695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.807391 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.807615 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.807764 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.807906 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808092 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808242 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808478 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808569 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808853 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.808953 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809165 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809255 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809475 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809568 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809785 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.809883 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810091 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810191 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810400 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810487 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810710 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.810820 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811014 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811101 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811319 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811406 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811625 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811720 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.811956 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812057 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812287 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812377 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812600 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812689 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812910 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.812997 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813221 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813308 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813526 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813613 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813832 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.813918 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814140 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814239 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814449 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814553 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814756 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.814947 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815084 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815189 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815392 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815481 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815694 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.815785 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816065 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816171 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816377 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816472 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816690 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.816820 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817003 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817101 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817380 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817481 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817644 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817792 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.817940 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818107 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818264 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818409 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818552 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818695 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.818848 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819002 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819171 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819322 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819508 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819673 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.819828 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820031 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820181 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820325 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820469 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820628 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820801 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.820945 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821099 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821242 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821384 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821539 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821692 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.821843 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822001 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822146 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822288 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822467 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822617 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822761 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.822921 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823064 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823219 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823363 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823505 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823646 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823788 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.823938 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824117 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824263 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824405 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824547 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824696 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.824849 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825001 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825145 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825288 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825437 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825580 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825747 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.825950 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826101 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826251 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826401 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826544 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826706 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.826849 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827001 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827143 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827292 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827435 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827585 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827757 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.827901 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828084 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828230 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828372 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828523 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828678 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828821 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.828963 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829105 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829256 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829399 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829541 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829706 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.829855 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830030 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830195 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830339 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830491 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830658 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830817 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.830994 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831101 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831361 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831455 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831584 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831675 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.831896 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832006 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832274 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832375 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832586 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832676 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832904 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.832997 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833223 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833313 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833541 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833630 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833867 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.833956 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.834176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.834262 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.834483 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.834579 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.834723 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 10:26:29.834827 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.835150 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.835465 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.835810 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.836166 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.836484 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.836796 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.837104 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:26:29.837351 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 10:26:29.858270 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:29.859985 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_db.sqlalchemy.engines [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.020620 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.context [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4342541e-f05b-438e-bfa3-eef56eb5f7a7(cell1) {{(pid=101212) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 10:26:30.021828 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.context [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4342541e-f05b-438e-bfa3-eef56eb5f7a7(cell1) {{(pid=101211) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 10:26:30.024938 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_concurrency.lockutils [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:26:30.026062 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:26:30.026924 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_concurrency.lockutils [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:26:30.027743 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_concurrency.lockutils [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:26:30.027885 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:26:30.028703 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:26:30.029694 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_concurrency.lockutils [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:26:30.030629 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:26:30.040275 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.044365 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.045005 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_db.sqlalchemy.engines [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.047035 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_db.sqlalchemy.engines [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.307911 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG oslo_db.sqlalchemy.engines [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.311093 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_db.sqlalchemy.engines [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:26:30.733396 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: WARNING keystonemiddleware.auth_token [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:26:30.740884 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: WARNING keystonemiddleware.auth_token [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:26:30.757022 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: WARNING keystonemiddleware.auth_token [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:26:30.764970 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: WARNING keystonemiddleware.auth_token [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:26:31.088933 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: WARNING keystonemiddleware.auth_token [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:26:31.095053 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: WARNING keystonemiddleware.auth_token [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:26:31.100176 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6f0ca49c0 pid: 101212 (default app) Nov 09 10:26:31.102234 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:26:31.103414 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Nov 09 10:26:31.103917 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Tue Nov 9 10:26:31 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:26:31.110640 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: WARNING keystonemiddleware.auth_token [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:26:31.115929 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: WARNING keystonemiddleware.auth_token [None req-f656be3d-bb9b-436d-aa44-e9dc2b7eb6be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:26:31.121838 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f6f0ca49c0 pid: 101211 (default app) Nov 09 10:27:58.106051 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:27:58.108674 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003134 Nov 09 10:27:58.109562 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:27:58 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:27:58.576660 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-e93b06bc-eed0-441f-8038-51ebaf3f1d71 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:27:58.607789 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-e93b06bc-eed0-441f-8038-51ebaf3f1d71 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.488549 Nov 09 10:27:58.608706 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Nov 9 10:27:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:00.991817 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:00.992962 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-ac2817f3-50ac-4be5-98ef-fdb737358460 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 09 10:28:00.993311 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:01.055670 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-e106cc4c-3c97-4e6d-8199-2648b5fadd3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:01.073729 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:28:01.073729 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:28:01.185984 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-e106cc4c-3c97-4e6d-8199-2648b5fadd3f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.185998 Nov 09 10:28:01.186580 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:28:01.406086 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-35d79225-4f7d-4ede-8765-1fe54fe1bceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:01.408452 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:28:01.408452 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: warnings.warn(msg) Nov 09 10:28:01.532878 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-35d79225-4f7d-4ede-8765-1fe54fe1bceb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337295 Nov 09 10:28:01.533534 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Nov 9 10:28:01 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:03.853737 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-e106cc4c-3c97-4e6d-8199-2648b5fadd3f admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:03.855422 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-e106cc4c-3c97-4e6d-8199-2648b5fadd3f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Nov 09 10:28:03.855832 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:03.986856 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-25411a0d-55d0-4be2-9ecb-07fe4d924e36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:04.006709 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:28:04.006709 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: warnings.warn(msg) Nov 09 10:28:04.222388 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-25411a0d-55d0-4be2-9ecb-07fe4d924e36 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.358771 Nov 09 10:28:04.231052 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:28:04.236098 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-d4772d01-bca7-494b-ae55-34f4d47cd66a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:04.237614 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:28:04.237614 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:28:04.369176 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-d4772d01-bca7-494b-ae55-34f4d47cd66a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136740 Nov 09 10:28:04.369764 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Nov 9 10:28:04 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:28:06.728195 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-25411a0d-55d0-4be2-9ecb-07fe4d924e36 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:06.729921 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-25411a0d-55d0-4be2-9ecb-07fe4d924e36 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Nov 09 10:28:06.730496 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:06.790078 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-129f3a85-0a67-43df-bee2-b426a0baeb63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:07.033510 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-129f3a85-0a67-43df-bee2-b426a0baeb63 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.296405 Nov 09 10:28:07.034064 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:07.047142 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-3138bfc6-db10-4778-b202-6e235141e3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:07.171570 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-3138bfc6-db10-4778-b202-6e235141e3e7 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126755 Nov 09 10:28:07.176638 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Nov 9 10:28:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:09.554212 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-129f3a85-0a67-43df-bee2-b426a0baeb63 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:09.555216 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-129f3a85-0a67-43df-bee2-b426a0baeb63 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 09 10:28:09.555607 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:09.614980 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-e72ca18e-3ea8-4eb5-875e-91461bd75819 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:09.719309 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-e72ca18e-3ea8-4eb5-875e-91461bd75819 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157100 Nov 09 10:28:09.719862 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:28:09.734049 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-95841ce5-dca0-47dd-965b-5ebc9f857509 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:09.837633 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-95841ce5-dca0-47dd-965b-5ebc9f857509 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107690 Nov 09 10:28:09.838438 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Nov 9 10:28:09 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:12.429682 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-e72ca18e-3ea8-4eb5-875e-91461bd75819 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:12.430686 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-e72ca18e-3ea8-4eb5-875e-91461bd75819 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 09 10:28:12.431092 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:12.491404 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G", "id": "d4", "swap": 0}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:12.589695 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151350 Nov 09 10:28:12.590305 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:12.605850 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-e1439fde-52d0-4017-a5a3-c665a0d71737 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:12.712677 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-e1439fde-52d0-4017-a5a3-c665a0d71737 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112187 Nov 09 10:28:12.723475 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Nov 9 10:28:12 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:15.122357 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:15.123653 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Nov 09 10:28:15.124199 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:15.202417 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-873ae504-bbef-4c38-8f7f-5ded360060b1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:15.227160 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-873ae504-bbef-4c38-8f7f-5ded360060b1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.094463 Nov 09 10:28:15.227712 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Nov 9 10:28:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:28:17.656929 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:17.657945 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-254e4796-ac5b-4a78-823d-6c39c7651eb1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 09 10:28:17.658353 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:17.749085 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-79b228c5-fd1f-4d0c-b7ce-960a4529333d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "ram": 512, "disk": 1, "id": "1"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:17.874987 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-79b228c5-fd1f-4d0c-b7ce-960a4529333d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.208540 Nov 09 10:28:17.875483 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:17 2021] POST /compute/v2.1/flavors => generated 402 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:17.888902 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-edeb5f99-d0e4-4407-a7e8-dff9395e8c63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:17.991396 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-edeb5f99-d0e4-4407-a7e8-dff9395e8c63 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106103 Nov 09 10:28:17.992137 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Nov 9 10:28:17 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:20.369045 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-79b228c5-fd1f-4d0c-b7ce-960a4529333d admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:20.370185 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-79b228c5-fd1f-4d0c-b7ce-960a4529333d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 09 10:28:20.370617 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:20.434809 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-b98ab989-77dc-48e0-b974-5eb58c0906b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "swap": 0}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:20.512958 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-b98ab989-77dc-48e0-b974-5eb58c0906b3 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135571 Nov 09 10:28:20.513517 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:20.526458 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-d903a310-8278-4b57-9086-ef4ddf92644f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:20.624677 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-d903a310-8278-4b57-9086-ef4ddf92644f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101587 Nov 09 10:28:20.625182 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Nov 9 10:28:20 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:28:22.989680 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-b98ab989-77dc-48e0-b974-5eb58c0906b3 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:22.990693 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-b98ab989-77dc-48e0-b974-5eb58c0906b3 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 09 10:28:22.991127 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:23.051334 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-54a2117f-9b29-41c6-bc78-7a66d1a76ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "ram": 4096, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:23.164794 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-54a2117f-9b29-41c6-bc78-7a66d1a76ff8 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.166931 Nov 09 10:28:23.165356 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:22 2021] POST /compute/v2.1/flavors => generated 406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:28:23.178316 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-60b34817-e49d-4621-b261-51e6cc8a7ffd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:23.298546 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-60b34817-e49d-4621-b261-51e6cc8a7ffd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124449 Nov 09 10:28:23.299236 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Nov 9 10:28:23 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:28:25.678173 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-54a2117f-9b29-41c6-bc78-7a66d1a76ff8 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:25.679177 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-54a2117f-9b29-41c6-bc78-7a66d1a76ff8 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Nov 09 10:28:25.688064 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:25 2021] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:25.745763 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-f937cca0-0a0d-47a8-b334-21f6da362565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "swap": 0, "name": "m1.large"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:25.844671 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-f937cca0-0a0d-47a8-b334-21f6da362565 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.156093 Nov 09 10:28:25.851546 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:25.858723 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-8e5cb71e-bcd2-4d8b-82b6-1bc52b35517d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:25.943060 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-8e5cb71e-bcd2-4d8b-82b6-1bc52b35517d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087539 Nov 09 10:28:25.944070 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Nov 9 10:28:25 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:28:28.369741 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-f937cca0-0a0d-47a8-b334-21f6da362565 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:28:28.370756 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-f937cca0-0a0d-47a8-b334-21f6da362565 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 09 10:28:28.371449 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:28:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:28:28.444864 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:28.553616 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.174944 Nov 09 10:28:28.554554 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Nov 9 10:28:28 2021] POST /compute/v2.1/flavors => generated 408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:28:28.572992 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-a6b94952-06d4-4fdc-a513-c5512d299a19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:28:28.654933 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-a6b94952-06d4-4fdc-a513-c5512d299a19 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087392 Nov 09 10:28:28.655525 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Nov 9 10:28:28 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:29:08.132336 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:08.133390 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Nov 09 10:29:08.133787 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:29:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:08.193410 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-68b1f1d5-c229-4e93-9eec-85a6b485d17d admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:08.210021 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-68b1f1d5-c229-4e93-9eec-85a6b485d17d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069383 Nov 09 10:29:08.210547 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Nov 9 10:29:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:29:09.765694 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:09.766695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-415328b6-4791-4d82-87e8-4bf0d4c71de0 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 09 10:29:09.767276 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:09.968490 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-014a9a4a-1822-47c7-8599-7ec19f98e492 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:09.974307 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.wsgi [None req-014a9a4a-1822-47c7-8599-7ec19f98e492 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 10:29:09.974884 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-014a9a4a-1822-47c7-8599-7ec19f98e492 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:09.975724 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-014a9a4a-1822-47c7-8599-7ec19f98e492 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063433 Nov 09 10:29:09.976295 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Nov 9 10:29:09 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 10:29:09.986203 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-cffde1b0-368b-491c-87af-33222ddd2ee7 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:10.008051 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-cffde1b0-368b-491c-87af-33222ddd2ee7 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025333 Nov 09 10:29:10.008629 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:29:10.020303 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-be64c7eb-6bf9-49ba-9f00-d1c4fffdbebd admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:10.041203 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-be64c7eb-6bf9-49ba-9f00-d1c4fffdbebd admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025120 Nov 09 10:29:10.041786 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:29:10.053685 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-4866524d-beb7-4a94-b337-03d14eb99f3f admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:10.059493 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.wsgi [None req-4866524d-beb7-4a94-b337-03d14eb99f3f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 09 10:29:10.060122 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-4866524d-beb7-4a94-b337-03d14eb99f3f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:10.060949 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-4866524d-beb7-4a94-b337-03d14eb99f3f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011503 Nov 09 10:29:10.061500 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Nov 9 10:29:10 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 09 10:29:11.482794 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-be64c7eb-6bf9-49ba-9f00-d1c4fffdbebd admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:11.483765 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-be64c7eb-6bf9-49ba-9f00-d1c4fffdbebd admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Nov 09 10:29:11.484190 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:11.679174 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-c93684db-ba37-4d62-bb73-a6a9762ccda2 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:11.685292 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.wsgi [None req-c93684db-ba37-4d62-bb73-a6a9762ccda2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 10:29:11.686031 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-c93684db-ba37-4d62-bb73-a6a9762ccda2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:11.686879 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-c93684db-ba37-4d62-bb73-a6a9762ccda2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065344 Nov 09 10:29:11.687449 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Nov 9 10:29:11 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 10:29:11.698455 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-de65edf2-fa85-411d-8963-ba84ebb47899 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:11.714315 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-de65edf2-fa85-411d-8963-ba84ebb47899 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019879 Nov 09 10:29:11.715085 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:29:11.726066 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-2cfcb1d8-0b16-407d-a1e0-844a545b8b86 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:11.744580 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-2cfcb1d8-0b16-407d-a1e0-844a545b8b86 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022690 Nov 09 10:29:11.745152 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:29:11.756160 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-03e4a2e6-cce9-43b1-aea1-96aba11e0fef admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:11.761739 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.wsgi [None req-03e4a2e6-cce9-43b1-aea1-96aba11e0fef admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 09 10:29:11.762389 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-03e4a2e6-cce9-43b1-aea1-96aba11e0fef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:11.763250 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-03e4a2e6-cce9-43b1-aea1-96aba11e0fef admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011482 Nov 09 10:29:11.764228 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Nov 9 10:29:11 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 10:29:13.209148 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-2cfcb1d8-0b16-407d-a1e0-844a545b8b86 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:13.210282 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-2cfcb1d8-0b16-407d-a1e0-844a545b8b86 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Nov 09 10:29:13.210695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:13.411116 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-66df5d3d-a02b-40f5-8bb1-f37e3623f4c2 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:13.416955 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.wsgi [None req-66df5d3d-a02b-40f5-8bb1-f37e3623f4c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 10:29:13.419498 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-66df5d3d-a02b-40f5-8bb1-f37e3623f4c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:13.419498 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-66df5d3d-a02b-40f5-8bb1-f37e3623f4c2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065500 Nov 09 10:29:13.419498 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:29:13 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 10:29:13.429886 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-5f8c1102-9309-4d50-a7e1-750dbfba04d3 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:13.445041 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-5f8c1102-9309-4d50-a7e1-750dbfba04d3 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018655 Nov 09 10:29:13.445630 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:29:13.458954 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:13.484783 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030877 Nov 09 10:29:13.485661 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Nov 9 10:29:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:29:13.496810 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-e2b68c05-dde8-4db2-98a1-9a9670c74ec3 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:13.502453 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.wsgi [None req-e2b68c05-dde8-4db2-98a1-9a9670c74ec3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 09 10:29:13.503091 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-e2b68c05-dde8-4db2-98a1-9a9670c74ec3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:29:13.504199 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-e2b68c05-dde8-4db2-98a1-9a9670c74ec3 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010801 Nov 09 10:29:13.504780 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:29:13 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 09 10:29:14.946615 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:14.947611 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 09 10:29:14.948016 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:15.139266 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-6a8552ad-9d64-41e1-9f04-7bc9239b28e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:29:15.217758 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-6a8552ad-9d64-41e1-9f04-7bc9239b28e8 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.131116 Nov 09 10:29:15.218238 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Nov 9 10:29:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:29:16.651504 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:16.652533 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 09 10:29:16.652927 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:16.845803 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-0afdb52e-b83a-4b27-ac2e-b7e047443d43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:29:16.916217 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-0afdb52e-b83a-4b27-ac2e-b7e047443d43 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.123071 Nov 09 10:29:16.916695 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Nov 9 10:29:16 2021] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:29:18.337150 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:18.338156 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 09 10:29:18.338547 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:18.533368 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-d18886d4-fa66-4049-b804-3f531b66338f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:29:18.608507 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-d18886d4-fa66-4049-b804-3f531b66338f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.130749 Nov 09 10:29:18.608984 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Nov 9 10:29:18 2021] POST /compute/v2.1/flavors => generated 407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:29:20.071306 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:20.072361 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 09 10:29:20.072754 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:20.263750 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-53c052b7-485c-49c9-8014-f610a7187206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:29:20.350311 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-53c052b7-485c-49c9-8014-f610a7187206 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138248 Nov 09 10:29:20.351157 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Nov 9 10:29:20 2021] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:29:21.787830 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:21.788893 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 09 10:29:21.789284 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:29:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:29:22.001087 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-527e1979-4063-4884-872f-9284b5507cb1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:29:22.020948 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-527e1979-4063-4884-872f-9284b5507cb1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077917 Nov 09 10:29:22.021536 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1202 bytes} [Tue Nov 9 10:29:21 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:30:10.158375 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.159381 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-6e29fec1-eeaa-4dae-9da5-8aa6462924de admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 09 10:30:10.159781 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 930 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:30:10.218140 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-3279c236-b946-4206-bf15-f2e620cd60b8 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.237285 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-3279c236-b946-4206-bf15-f2e620cd60b8 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070594 Nov 09 10:30:10.237823 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:30:10.260950 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-179d0ed6-799e-4211-ad86-4d5074a0a07f admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.269275 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-179d0ed6-799e-4211-ad86-4d5074a0a07f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Nov 09 10:30:10.269807 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1282 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:30:10.281801 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-d4afe507-71f9-4772-a7ca-33e2d104c4f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.289486 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-d4afe507-71f9-4772-a7ca-33e2d104c4f1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011205 Nov 09 10:30:10.290013 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1285 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:30:10.304371 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-78466e8b-70a1-4f2c-a25e-dcf6fdde6472 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.318396 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-78466e8b-70a1-4f2c-a25e-dcf6fdde6472 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019243 Nov 09 10:30:10.319376 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1285 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:30:10.332897 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:30:10.341134 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012489 Nov 09 10:30:10.341708 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1282 bytes} [Tue Nov 9 10:30:10 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:31:45.931734 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-eed3fd62-c0f9-4243-9814-bb0985bf2c17 tempest-verify_tempest_config-704866507 tempest-verify_tempest_config-704866507-project] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:31:45.945355 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-eed3fd62-c0f9-4243-9814-bb0985bf2c17 tempest-verify_tempest_config-704866507 tempest-verify_tempest_config-704866507-project] 10.222.0.35 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105507 Nov 09 10:31:45.945355 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Nov 9 10:31:45 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:33:19.946568 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:19.947564 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 09 10:33:19.947952 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:33:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:33:20.217073 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:20.218212 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:33:20.218212 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:33:20.219740 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:20.220211 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:20.221003 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:20.221432 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:20.254602 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-c74dd10d-22ca-4663-a290-920258658027 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.167371 Nov 09 10:33:20.255168 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 35/71] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:33:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:33:21.714651 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:21.715640 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 09 10:33:21.716054 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:33:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:33:21.930451 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:21.931568 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:33:21.931568 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:33:21.933173 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:21.933598 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:21.934391 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:21.934815 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:21.954334 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-54d51956-9547-4323-9700-bcd759a4cc17 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081482 Nov 09 10:33:21.954905 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 36/73] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:33:21 2021] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:33:33.830958 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:33.831937 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Nov 09 10:33:33.832351 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 38/74] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:33:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:33:34.026026 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:34.027262 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:33:34.027262 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:33:34.028842 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:34.029284 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:34.030126 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:34.030549 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:34.054657 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-c085dbad-3a42-4823-bce1-3849fe352081 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081163 Nov 09 10:33:34.055199 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 37/75] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:33:33 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:33:35.489685 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: DEBUG nova.api.openstack.wsgi [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] Calling method '>' {{(pid=101212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:35.490687 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: INFO nova.api.openstack.requestlog [None req-95174188-a8d6-4693-b695-6303e06ce7f1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Nov 09 10:33:35.491451 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: [pid: 101212|app: 0|req: 39/76] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Nov 9 10:33:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:33:35.700440 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG nova.api.openstack.wsgi [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] Calling method '>' {{(pid=101211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:33:35.701639 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:33:35.701639 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: warnings.warn(msg) Nov 09 10:33:35.703156 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:35.703599 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:35.704428 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:33:35.704857 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: DEBUG oslo_concurrency.lockutils [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:33:35.726430 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: INFO nova.api.openstack.requestlog [None req-8c79ec22-7b90-4cb5-8630-4ae52a9e84fc admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081577 Nov 09 10:33:35.727036 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: [pid: 101211|app: 0|req: 38/77] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Nov 9 10:33:35 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:34:34.731214 dv-cinder-816628-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 09 10:34:34.731733 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: Tue Nov 9 10:34:34 2021 - graceful shutdown triggered... Nov 09 10:34:34.732184 dv-cinder-816628-1-iscsi devstack@n-api.service[101212]: Gracefully killing worker 2 (pid: 101212)... Nov 09 10:34:34.732643 dv-cinder-816628-1-iscsi devstack@n-api.service[101211]: Gracefully killing worker 1 (pid: 101211)... Nov 09 10:34:35.732857 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: worker 1 buried after 1 seconds Nov 09 10:34:35.733319 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: worker 2 buried after 1 seconds Nov 09 10:34:35.733319 dv-cinder-816628-1-iscsi devstack@n-api.service[101210]: goodbye to uWSGI. Nov 09 10:34:35.734446 dv-cinder-816628-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 09 10:34:35.734986 dv-cinder-816628-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 09 10:34:35.737848 dv-cinder-816628-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 09 10:34:35.747961 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 10:34:35 2021] *** Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: nodename: dv-cinder-816628-1-iscsi Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: machine: x86_64 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: clock source: unix Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: pcre jit disabled Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: detected number of CPU cores: 4 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: current working directory: / Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: detected binary path: /usr/bin/uwsgi-core Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: your processes number limit is 47680 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: your memory page size is 4096 bytes Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: detected max file descriptor number: 2048 Nov 09 10:34:35.749999 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: lock engine: pthread robust mutexes Nov 09 10:34:35.750866 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: thunder lock: enabled Nov 09 10:34:35.750866 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 09 10:34:35.750866 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 10:34:35.794879 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: Python main interpreter initialized at 0x5595860939c0 Nov 09 10:34:35.794879 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: python threads support enabled Nov 09 10:34:35.794879 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: your server socket listen backlog is limited to 100 connections Nov 09 10:34:35.794879 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: your mercy for graceful operations on workers is 90 seconds Nov 09 10:34:35.795309 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 10:34:35.795309 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: *** Operational MODE: preforking *** Nov 09 10:34:35.795598 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: *** uWSGI is running in multiple interpreter mode *** Nov 09 10:34:35.795598 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: spawned uWSGI master process (pid: 122660) Nov 09 10:34:35.795807 dv-cinder-816628-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 09 10:34:35.796820 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: spawned uWSGI worker 1 (pid: 122672, cores: 1) Nov 09 10:34:35.796820 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: spawned uWSGI worker 2 (pid: 122673, cores: 1) Nov 09 10:34:35.797008 dv-cinder-816628-1-iscsi devstack@n-api.service[122660]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 10:34:37.637867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:34:37.637867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: from cryptography.utils import int_from_bytes Nov 09 10:34:37.638574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:34:37.638574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: from cryptography.utils import int_from_bytes Nov 09 10:34:37.663937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:34:37.663937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: from cryptography.utils import int_from_bytes Nov 09 10:34:37.664756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 10:34:37.664756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: from cryptography.utils import int_from_bytes Nov 09 10:34:40.280900 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 10:34:40.281500 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 10:34:40.281610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.284940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.285586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.285586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.285758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.286055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816628-1-iscsi {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.286384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.286699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.287031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.287340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.287650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.287993 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.288315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.288854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290660 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.290876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.291162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.291468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.291799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.292144 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.292610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816628-1-iscsi {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.292932 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.293253 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.293583 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.294019 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.294326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.294637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.295066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.295309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.295622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.295941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.296291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.296614 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.296947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.297249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.297568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.298051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.298196 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.298507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.298819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.299078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.299394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.299725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.300142 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.300469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.300672 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.300929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.301254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.301585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.301899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.302217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.302534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.302865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.303164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.303476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.303881 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.304124 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.304981 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.305315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.305647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.305961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.306287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.306699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.306970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.307280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.307623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.307952 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.308289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.308616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.308946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.309265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.309579 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.309896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.310224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.310566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.310884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.311140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.311450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.311763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.312111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.312426 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.312743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.313057 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.313367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.314326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.314326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.314326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.315063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.315063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.315203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.315502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.315817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.316153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.316483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.316811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.317129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.317442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.317753 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.318072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.318401 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.318717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.319030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.319359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.319673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.320011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.320943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.321223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.321540 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.321870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.322183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.322493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.322826 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.323153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.323491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.323766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.324100 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.324416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.324728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.325040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.325353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.325666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.325994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.326319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.326490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 10:34:40.326985 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.327138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 10:34:40.327301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.327471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 10:34:40.327627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.327627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.327927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 10:34:40.327927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 10:34:40.328264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.328264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.329882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.330068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.330223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.330375 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.330539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.330691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.330850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.331075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.331228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.331379 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.331522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.331663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.331821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.332053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.332245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.332404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.332554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.332717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.332870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.333015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.333165 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.333318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.333460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816628-1-iscsi {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.333611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.334201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.334391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.334540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.334693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.334846 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.335015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.335166 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.335308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.335450 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.335591 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.335782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.335944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.336153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.336306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.336306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.336575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.336759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.336910 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.337059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.337210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.337210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.337489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.337682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.337845 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.338009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.338161 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.338305 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.338446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.338651 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.338806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.338955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.339104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.339253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.339415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.339659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.339802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.339925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816628-1-iscsi {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.345655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.345832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.345987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.346139 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.346282 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.346437 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.346587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.346587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.346883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.347039 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.347186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.347327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.347467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.347617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.347767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.347909 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.348132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.348295 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.348451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.348601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.348753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.348904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.349063 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.349207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.349362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.349513 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.349667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.349817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.349967 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.350117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.350282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.350431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.350581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.350724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.350876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.351025 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.351177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.351319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.352003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.352003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.352291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.352442 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.352584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.352745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.352894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.353044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.353187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.353337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.353482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.353631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.353780 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.353948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.354631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.354631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.354939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.355092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.355236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.355386 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.355539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.355682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.355833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.356026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.356188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.356339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.356492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.356492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.356767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.356932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.357093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.357251 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.357393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.357393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.357676 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.357818 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.357966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.358122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.358265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.358406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.358556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.358705 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.358864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.359021 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.359164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.359306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.359455 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.359597 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.359745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.359896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.360082 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.360226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.360376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.360530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.360691 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.361037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.361189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.361341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.361485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.361635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.361792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.361935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.362077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.362218 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.362361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.362502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.362653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.362815 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.362971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.363121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.363264 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.363406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.363556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.363712 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.363855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.364045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.364728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.364901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.365047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.365199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.365353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.365496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.365646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.365788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.365937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.365937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.366218 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.366368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.366518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.366673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.366816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.367044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.367204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.367358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.367523 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.367746 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.367914 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.368060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.368173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.373370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.373545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.373708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.373855 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.374016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.374164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.374306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.375018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.375182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.375336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.375487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.375639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.375791 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.375935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.376137 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.376291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.376442 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.376584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.376734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.376884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.377056 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.377200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.377342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.377493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.377637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.377884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.378048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.378200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.378351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.378504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.378647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.378789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.378942 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.379085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.379241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.379392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.379542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.379684 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.379826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.380010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.380179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.380323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.380465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.380607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.380765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.380929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.381081 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.381232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.381376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.381518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.381659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.381807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.381962 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.382176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.382342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.382487 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.383117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.383267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.383435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.383593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.383771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.383916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.384103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.384257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.384411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.384580 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.385256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.385987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.386139 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.386301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.386453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.386612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.386756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.387139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.387304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 10:34:40.387462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.387616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.387774 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.387946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.388165 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.388325 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.388527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.388689 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.388849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389820 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.389978 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390130 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.390921 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391509 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391805 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.391955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392145 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392439 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392590 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.392903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393047 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393784 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.393936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.394228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.394372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.394519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.394681 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.395718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.395877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396221 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.396953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.397999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.398150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.398904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.399261 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.399431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.399585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.399729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.399878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.400109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.400272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.400420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.400905 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401644 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401751 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.401928 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402021 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402559 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402830 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.402911 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403006 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403168 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403419 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403583 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.403930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.404029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.407915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408900 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.408984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.409945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410272 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410624 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410708 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.410976 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411329 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411854 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.411944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412184 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.412940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413284 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413464 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.413931 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414441 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414703 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414793 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.414967 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415062 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415170 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415407 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.415864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.416638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.416758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.416854 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.416950 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417128 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417217 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417300 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417537 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.417975 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418327 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418774 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.418947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419130 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419231 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419415 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419662 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.419880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.420108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.420875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.420973 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421139 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421216 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421505 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.421946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422025 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422172 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422900 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.422968 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423124 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423332 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423434 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423589 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.423895 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.424148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.424233 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.425522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.425626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.425707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.425800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426724 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.426961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.427051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.427141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.427224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428340 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428503 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.428949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.429949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430126 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430209 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430568 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.430984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431169 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431333 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431426 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431831 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.431920 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432409 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432840 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.432929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433334 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.433876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434021 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434169 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434251 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434868 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.434956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435184 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435434 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.435952 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436818 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.436917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437004 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437505 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437672 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437871 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.437953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438579 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.438938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439019 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.439998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440786 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.440954 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441297 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441377 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441560 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441738 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.441973 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442056 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.442981 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.443834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.444970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.445656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.445816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.445971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.446928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447063 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447551 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.447954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448354 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448505 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448645 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.448966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449428 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.449870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450350 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.450964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451108 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.451875 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.452977 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453268 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453436 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.453892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454177 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454821 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.454995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455137 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455441 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.455925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.456979 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457787 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.457887 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458184 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458399 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.458843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459132 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.459957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460386 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460770 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.460975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461073 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461632 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.461954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462587 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462681 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.462904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463000 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.463959 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.464893 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465755 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.465844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466714 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.466830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.467919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468042 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468889 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.468986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469831 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.469927 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470143 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470450 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.470851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.471808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472774 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.472984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.473964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474277 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474598 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.474920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475017 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475238 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475552 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.475978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.476210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.476842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477238 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477667 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.477975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478442 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.478950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.479890 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480525 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.480907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481079 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481266 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.481867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482708 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.482868 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483038 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483183 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.483823 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484003 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484313 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.484951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.485901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.486094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.486217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.486412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.486732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.486835 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487689 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.487805 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488133 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488676 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.488774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489325 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489414 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.489988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490405 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490712 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.490926 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491232 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491320 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491643 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.491857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492868 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.492970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493488 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.493884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494509 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.494816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.495985 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496302 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496400 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496614 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.496917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.497019 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.497463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.497548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.498997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.499994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500102 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500395 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.500971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501061 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501293 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501840 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.501983 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.502247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.502337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.502581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.502673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.502934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503026 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.503990 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.504924 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.505857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506179 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506386 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506693 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.506791 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.507009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.507112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.507329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.507430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.508976 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509301 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509841 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.509933 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.510881 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511434 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.511850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512402 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.512980 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.513072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.513332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.513433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.513690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.513873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514840 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.514997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.515156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.515323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.515474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.515640 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.515790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516012 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516137 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.516765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517003 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517415 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.517934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518505 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518591 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518663 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518893 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.518992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.519954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520309 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.520971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521274 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521583 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.521918 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522759 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.522858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523183 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.523843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524744 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.524836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525478 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.525806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526024 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.526961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527209 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.527982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.528968 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529468 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.529881 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.530842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.531771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.532003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.532114 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.532360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.532549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.532700 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 10:34:40.532901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.533223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.533551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.533879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.534200 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.534511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.534837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.535167 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.535478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.535801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.536140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.536452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.536762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.537077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.537392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.537699 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.538013 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.538321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.538656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.539485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.539796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.540134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.540454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.540764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.541077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.541387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.541694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.542011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.542320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.542633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.542940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.543256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.543563 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.543874 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.544208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.544535 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.544845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.545162 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.545469 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.545783 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.546108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.546425 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.546740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.547089 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.547406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.547955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.548368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.548800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.549044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.549394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.549707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.550021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.550335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.550946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.551418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.552012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.552616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.553211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.553783 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.554376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.555101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.555694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.555791 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_db.sqlalchemy.engines [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.556272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.556861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.557285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.557633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.558013 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.558359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.558692 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.559028 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.559475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.560055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.560659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.561308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.561909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.562458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.563289 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.563887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.564479 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.565074 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.565519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.565932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.566132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.566467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.566809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.567140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.567486 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.567842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.568212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.568555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.568935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.569310 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.569628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.569952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.570901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.571230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.571570 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.571892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.572254 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.572576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.572910 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.573242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.573582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.573901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.574241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.574562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.574880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.575199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.575520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.575833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.576176 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.576510 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.576845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.577158 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.577490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.577813 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.578142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.578465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.578777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.579400 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.579722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.580070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.580392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.580710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.581030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.581358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.581690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.582020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.582350 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.582681 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.583031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.583347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.583697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.584053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.584375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.584694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.585003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 10:34:40.585249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122672) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 10:34:40.608028 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_db.sqlalchemy.engines [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.628506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.context [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4342541e-f05b-438e-bfa3-eef56eb5f7a7(cell1) {{(pid=122673) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 10:34:40.632861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:34:40.634450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:34:40.635260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:34:40.637219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:34:40.648075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_db.sqlalchemy.engines [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.648984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_db.sqlalchemy.engines [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.675679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.context [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4342541e-f05b-438e-bfa3-eef56eb5f7a7(cell1) {{(pid=122672) load_cells /opt/stack/nova/nova/context.py:464}} Nov 09 10:34:40.680569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:34:40.682120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:34:40.682939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:34:40.685096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:34:40.695513 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_db.sqlalchemy.engines [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.696383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_db.sqlalchemy.engines [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.916444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_db.sqlalchemy.engines [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:40.963146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_db.sqlalchemy.engines [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122672) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 10:34:41.246032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: WARNING keystonemiddleware.auth_token [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:34:41.254039 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: WARNING keystonemiddleware.auth_token [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:34:41.291950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: WARNING keystonemiddleware.auth_token [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:34:41.300497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: WARNING keystonemiddleware.auth_token [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:34:41.608779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: WARNING keystonemiddleware.auth_token [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:34:41.614115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: WARNING keystonemiddleware.auth_token [None req-c9640c46-cf9b-4d9e-8660-c326257ca0b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:34:41.620730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595860939c0 pid: 122673 (default app) Nov 09 10:34:41.652705 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: WARNING keystonemiddleware.auth_token [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 09 10:34:41.658097 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: WARNING keystonemiddleware.auth_token [None req-154c3163-d6ef-48a5-b5c4-1cd176d32237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 09 10:34:41.665079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595860939c0 pid: 122672 (default app) Nov 09 10:35:16.969390 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2d94ed7e-10e0-40c1-bd68-dab4c915182c tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Action: 'create', calling method: .version_select at 0x7f53dee67280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-627520096"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:19.391398 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2d94ed7e-10e0-40c1-bd68-dab4c915182c tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.504965 Nov 09 10:35:19.392428 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1154 bytes} [Tue Nov 9 10:35:15 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 10:35:19.405502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-685e6dcd-ac9b-44e3-9f65-ed461b0c1848 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ded27e50>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:19.603145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1719773316", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "a0acbc6a-fb34-43c2-885e-eb403620ff93"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:19.710292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-685e6dcd-ac9b-44e3-9f65-ed461b0c1848 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 200 len: 344 microversion: 2.1 time: 0.307656 Nov 09 10:35:19.712257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 2/2] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:19 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 344 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:19.902410 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-18656577", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "5554d1a8-4766-4ee1-bd4f-871198ca55f6"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:20.092628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] validate_networks() for [('5554d1a8-4766-4ee1-bd4f-871198ca55f6', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:20.171478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] validate_networks() for [('a0acbc6a-fb34-43c2-885e-eb403620ff93', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:21.185602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:21.186175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:21.186469 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:21.186874 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:21.187640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:21.202616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:21.203408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:21.204571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:21.205227 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:21.263182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Getting quotas for project bc589f1addda41c09c4c042f7af97752. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:21.275906 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Getting quotas for user 38e5a722dfa64974b62e590a559a0e00 and project bc589f1addda41c09c4c042f7af97752. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:21.305551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:21.310311 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:21.472618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:21.472618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:21.472618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:21.472618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:21.472618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:21.494392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:21.494869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:21.495765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:21.653770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:21.653770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:21.653770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for user 1a255547966e430bac7a2b4d0c0727b1 and project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:21.653770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:21.655416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:21.678568 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-51849f1c-73d3-44ed-8689-5f1ead288974 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836275 Nov 09 10:35:21.680180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:35:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:35:21.691397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9e766922-f45a-4442-85ec-66e6055c5a1a tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53dec51c10>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:21.824048 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e6325cb3-9be7-4fa2-9813-8c17cd0f6769 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008904 Nov 09 10:35:21.830951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 3/4] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:35:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:35:21.838520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cc77fd08-f955-4b9f-afd2-ca47481a924f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:21.839364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cc77fd08-f955-4b9f-afd2-ca47481a924f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:21.855745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9e766922-f45a-4442-85ec-66e6055c5a1a tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 200 len: 345 microversion: 2.1 time: 0.173817 Nov 09 10:35:21.856181 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 2/5] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:21 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:21.860982 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-44800357-ae87-43ee-ab30-2bc6a253c180 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:21.861597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-44800357-ae87-43ee-ab30-2bc6a253c180 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:22.031293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-44800357-ae87-43ee-ab30-2bc6a253c180 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:22.059195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-44800357-ae87-43ee-ab30-2bc6a253c180 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1216 microversion: 2.1 time: 0.201668 Nov 09 10:35:22.059796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 3/6] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:21 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:22.101173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9c9f6d45-470d-4144-b2eb-f486a823e62e tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Action: 'create', calling method: .version_select at 0x7f53ddbeb1f0>, body: {"snapshot": {"volume_id": "8e1648d6-f119-431f-a762-5a4b1524f236", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-85498460"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:22.240338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cc77fd08-f955-4b9f-afd2-ca47481a924f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:22.265246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cc77fd08-f955-4b9f-afd2-ca47481a924f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1215 microversion: 2.1 time: 0.432266 Nov 09 10:35:22.265846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 4/7] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:21 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:23.077079 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ccf18fd0-3272-4f5e-bacf-2fa40bda3008 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:23.077987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ccf18fd0-3272-4f5e-bacf-2fa40bda3008 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:23.234680 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ccf18fd0-3272-4f5e-bacf-2fa40bda3008 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:23.252161 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ccf18fd0-3272-4f5e-bacf-2fa40bda3008 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1216 microversion: 2.1 time: 0.179027 Nov 09 10:35:23.254971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 5/8] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:23 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:23.291401 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-35a18c1d-e8ad-4ffd-8d4e-78d8ca28b307 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:23.294224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-35a18c1d-e8ad-4ffd-8d4e-78d8ca28b307 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:23.314531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9c9f6d45-470d-4144-b2eb-f486a823e62e tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 1.239448 Nov 09 10:35:23.315732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 4/9] 10.222.0.35 () {60 vars in 1161 bytes} [Tue Nov 9 10:35:22 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:23.326906 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8e19602e-387c-4187-b08c-d0fa1412b900 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddbebee0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:23.558147 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-35a18c1d-e8ad-4ffd-8d4e-78d8ca28b307 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:23.568214 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-35a18c1d-e8ad-4ffd-8d4e-78d8ca28b307 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1215 microversion: 2.1 time: 0.281198 Nov 09 10:35:23.569403 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 6/10] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:23 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:23.581275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8e19602e-387c-4187-b08c-d0fa1412b900 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 285 microversion: 2.1 time: 0.258882 Nov 09 10:35:23.587914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 5/11] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:23 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:23.594065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c7057b4-028a-4c5e-afb9-f67a73a9e508 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53de3e0ee0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:23.652937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6c7057b4-028a-4c5e-afb9-f67a73a9e508 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.063960 Nov 09 10:35:23.654740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 7/12] 10.222.0.35 () {58 vars in 1139 bytes} [Tue Nov 9 10:35:23 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:23.666035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-23b369bd-655c-4374-b4f7-20d7a80ab5a3 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb800d0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:23.741357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-23b369bd-655c-4374-b4f7-20d7a80ab5a3 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 285 microversion: 2.1 time: 0.056196 Nov 09 10:35:23.741357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 6/13] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:23 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 285 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:24.274015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3d23daea-b18c-454b-acd2-8cb2544445bc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:24.276903 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3d23daea-b18c-454b-acd2-8cb2544445bc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:24.523550 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3d23daea-b18c-454b-acd2-8cb2544445bc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:24.544185 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3d23daea-b18c-454b-acd2-8cb2544445bc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1216 microversion: 2.1 time: 0.275173 Nov 09 10:35:24.555365 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 8/14] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:24 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1216 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:24.587140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7d39f633-5fc5-454c-958b-2078c4cdfe7d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:24.587859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7d39f633-5fc5-454c-958b-2078c4cdfe7d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:24.730418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2d760f95-01ce-4784-b569-5e4197c3961b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb87160>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:24.737634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7d39f633-5fc5-454c-958b-2078c4cdfe7d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:24.761444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7d39f633-5fc5-454c-958b-2078c4cdfe7d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1215 microversion: 2.1 time: 0.178548 Nov 09 10:35:24.772414 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 7/15] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:24 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:24.783568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2d760f95-01ce-4784-b569-5e4197c3961b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 285 microversion: 2.1 time: 0.057126 Nov 09 10:35:24.784464 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 9/16] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:24 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 285 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:25.562828 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:25.563508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:25.575584 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:25.580083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:25.581439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:25.582103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:25.780016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:25.782845 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:25.797953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:25.800660 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:25.801432 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:25.801878 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:25.863781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:25.883887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b3cfe4aa-0f9b-43b4-851a-1acac5b592ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1220 microversion: 2.1 time: 0.324742 Nov 09 10:35:25.886322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 8/17] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:25 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:25.899084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9486f403-5b0c-48e6-9646-24f3bff2e39f tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddaf3b80>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:26.063566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9486f403-5b0c-48e6-9646-24f3bff2e39f tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 285 microversion: 2.1 time: 0.175041 Nov 09 10:35:26.064280 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 9/18] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:25 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:26.138426 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:26.158618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d4d349e5-274a-4518-8179-2dc97e6d19cc tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1219 microversion: 2.1 time: 0.382410 Nov 09 10:35:26.159435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 10/19] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:25 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1219 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:26.913214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:26.914447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:26.929222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:26.941557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:26.951808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:26.951808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:27.083417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5552fc90-4e0d-4f72-91d3-c221214ee561 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb70af0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:27.178631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5552fc90-4e0d-4f72-91d3-c221214ee561 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 286 microversion: 2.1 time: 0.101950 Nov 09 10:35:27.185048 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 11/20] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:27 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:27.189541 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:27.190674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:27.228921 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:27.242961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9334c5bf-95de-41be-8a5b-be5a06c94f91 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1220 microversion: 2.1 time: 0.333282 Nov 09 10:35:27.245072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 10/21] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:26 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1220 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:27.250105 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:27.250857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:27.251702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:27.252183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:27.259032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-32621a5d-5964-4c6f-915e-a5026605e872 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddaf34c0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:27.469433 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:27.482978 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4ba38c43-7c67-4bf6-adbf-444aa0f2932f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1219 microversion: 2.1 time: 0.301396 Nov 09 10:35:27.483592 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 12/22] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:27 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:27.508140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-32621a5d-5964-4c6f-915e-a5026605e872 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 202 len: 0 microversion: 2.1 time: 0.254016 Nov 09 10:35:27.508140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 11/23] 10.222.0.35 () {58 vars in 1253 bytes} [Tue Nov 9 10:35:27 2021] DELETE /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:35:27.515729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-63c2c25b-29d7-483b-8784-54c91e1d950a tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb118b0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:27.575208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-63c2c25b-29d7-483b-8784-54c91e1d950a tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 200 len: 285 microversion: 2.1 time: 0.063956 Nov 09 10:35:27.576490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 12/24] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:27 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 285 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:28.159435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2119452827", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7356e1ef-978e-49fa-bc2d-b1ac03294fba"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:28.159435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] validate_networks() for [('7356e1ef-978e-49fa-bc2d-b1ac03294fba', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:28.261245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:28.261876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:28.270435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.270893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.271678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.291288 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.485175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:28.485904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:28.486651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:28.487210 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:28.487824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:28.501384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.502046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.503227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.503612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.524560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Getting quotas for project 72d2f00c4c004c6b91287e418c91d927. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:28.535387 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Getting quotas for user 60785dfae7854bcea54ebd88af4dd93f and project 72d2f00c4c004c6b91287e418c91d927. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:28.564964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:28.567624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:28.711913 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:28.727809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3868b0de-71bc-44c6-9944-a8be3d07fe1b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1268 microversion: 2.1 time: 0.470174 Nov 09 10:35:28.729533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 13/25] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:28 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1268 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:28.743551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:28.755491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:28.777206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.779509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.782511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:28.784428 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:28.841792 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-79118b2d-5f15-43b4-917c-ba151845fe0c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.357033 Nov 09 10:35:28.853939 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 13/26] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:35:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:35:28.878887 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bb235d70-e3d9-4c51-be25-3aaa4b9f3ce6 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb10550>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:28.980760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:28.996175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7402aa0c-e5db-4456-b9a6-a271d2ea38d4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1267 microversion: 2.1 time: 0.261623 Nov 09 10:35:28.996967 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 14/27] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:28 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:29.004011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dbe04af9-3895-4dca-b739-b30aa70fbb2a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:29.004775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dbe04af9-3895-4dca-b739-b30aa70fbb2a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:29.074925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-bb235d70-e3d9-4c51-be25-3aaa4b9f3ce6 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] HTTP exception thrown: Snapshot 2cd2dd04-515e-4a1c-8f8b-93c89d13b775 could not be found. Nov 09 10:35:29.074925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bb235d70-e3d9-4c51-be25-3aaa4b9f3ce6 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Returning 404 to user: Snapshot 2cd2dd04-515e-4a1c-8f8b-93c89d13b775 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:35:29.074925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bb235d70-e3d9-4c51-be25-3aaa4b9f3ce6 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775" status: 404 len: 111 microversion: 2.1 time: 0.216628 Nov 09 10:35:29.074925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 14/28] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Nov 9 10:35:28 2021] GET /compute/v2.1/os-snapshots/2cd2dd04-515e-4a1c-8f8b-93c89d13b775 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:35:29.081605 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d039fd71-f7e6-42f5-84ef-d031e4757c03 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb100d0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:29.123196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dbe04af9-3895-4dca-b739-b30aa70fbb2a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:29.131984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dbe04af9-3895-4dca-b739-b30aa70fbb2a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1222 microversion: 2.1 time: 0.133395 Nov 09 10:35:29.132717 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 15/29] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:28 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:29.427387 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d039fd71-f7e6-42f5-84ef-d031e4757c03 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 202 len: 0 microversion: 2.1 time: 0.349590 Nov 09 10:35:29.428340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 15/30] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:35:29 2021] DELETE /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:35:29.437483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-59ae87ed-dfdc-4a32-96f7-8ef9b23c36ab tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb2fe50>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:29.450669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1006879042", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7356e1ef-978e-49fa-bc2d-b1ac03294fba"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:29.555837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-59ae87ed-dfdc-4a32-96f7-8ef9b23c36ab tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 200 len: 344 microversion: 2.1 time: 0.121024 Nov 09 10:35:29.561709 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 16/31] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:29 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:29.564526 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] validate_networks() for [('7356e1ef-978e-49fa-bc2d-b1ac03294fba', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:29.751006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:29.751620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:29.763700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:29.763700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:29.763700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:29.763700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:29.901573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:29.920291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9507b2db-02bd-45a8-9260-acf6205a6b43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1274 microversion: 2.1 time: 0.166648 Nov 09 10:35:29.920291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 17/32] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:29 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:30.018225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:30.018877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:30.025389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:30.026311 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:30.026638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:30.027067 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:30.145035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:30.157792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5d248b22-dad5-43b0-9293-bc79cf5ff18c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1267 microversion: 2.1 time: 0.142830 Nov 09 10:35:30.171574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 18/33] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:30 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:30.249553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:30.250132 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:30.250880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:30.251445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:30.252021 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:30.262908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:30.266198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:30.266198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:30.266198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:30.286534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Getting quotas for project 72d2f00c4c004c6b91287e418c91d927. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:30.292785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Getting quotas for user 60785dfae7854bcea54ebd88af4dd93f and project 72d2f00c4c004c6b91287e418c91d927. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:30.312219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:30.313815 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:30.402546 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: .version_select at 0x7f53df68d940>, body: {"keypair": {"name": "tempest-keypair-76977645"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:30.433036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:30.437478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:30.572231 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-294f4cdd-dd11-404e-950e-4429062abc32 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.123678 Nov 09 10:35:30.593711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 16/34] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:35:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:35:30.601737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cf35cd75-0b8d-4a46-9fa8-a3a1a32628e0 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb70ee0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:30.698512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cf35cd75-0b8d-4a46-9fa8-a3a1a32628e0 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 200 len: 344 microversion: 2.1 time: 0.097438 Nov 09 10:35:30.698512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 17/35] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:30 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 344 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:30.702669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-005d3ef7-2bc8-4baf-91e6-4b924404b678 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:30.703636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-005d3ef7-2bc8-4baf-91e6-4b924404b678 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:31.033360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-005d3ef7-2bc8-4baf-91e6-4b924404b678 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:31.045262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-005d3ef7-2bc8-4baf-91e6-4b924404b678 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1222 microversion: 2.1 time: 0.351021 Nov 09 10:35:31.046639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 18/36] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:30 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1222 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:31.053685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:31.055392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:31.062544 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:31.063403 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:31.064762 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:31.065382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:31.129762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:31.151705 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:31.201822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-05cfbeae-6c9a-4140-93c0-e88f05c0a8f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 1.032349 Nov 09 10:35:31.202614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 19/37] 10.222.0.35 () {62 vars in 1198 bytes} [Tue Nov 9 10:35:30 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1034 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 10:35:31.209807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:31.216583 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:31.217214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:31.230413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4975c4da-eb80-4b91-a367-99a729a3b661 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1274 microversion: 2.1 time: 0.181908 Nov 09 10:35:31.231235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 19/38] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:31 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:31.240622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:31.241320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:31.242369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:31.242964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:31.327296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:31.339235 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6846b571-dd0e-4740-82c5-9e1f46281e54 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1267 microversion: 2.1 time: 0.130180 Nov 09 10:35:31.347728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 20/39] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:31 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:31.706453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-77362dd3-33dd-4e99-a30d-638ed0c79dcc tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb2d790>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:31.771883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-77362dd3-33dd-4e99-a30d-638ed0c79dcc tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 200 len: 344 microversion: 2.1 time: 0.068834 Nov 09 10:35:31.772646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 20/40] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:31 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:32.072636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:32.073944 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:32.083284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.085341 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.086913 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.088626 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.241086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:32.247126 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:32.249675 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:32.261154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e0bb27a6-ed1b-423e-81b8-3fa0684fe61b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1226 microversion: 2.1 time: 0.195846 Nov 09 10:35:32.268907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 21/41] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:32 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:32.269158 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.269773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.272935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.273605 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.362415 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:32.363420 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:32.374245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.374704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.375506 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:32.375938 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:32.590206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:32.621647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-39710e65-95b9-43de-8214-1470f06c98de tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1274 microversion: 2.1 time: 0.376554 Nov 09 10:35:32.625414 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 21/42] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:32 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:32.705435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:32.714757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a052d0b3-4760-4a57-945c-e9d4b8e2477f tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1275 microversion: 2.1 time: 0.356300 Nov 09 10:35:32.717819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 22/43] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:32 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1275 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:32.788386 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b1b24f9d-a569-49d7-9c1d-813f8dff91af tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddb70af0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:32.842254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-b1b24f9d-a569-49d7-9c1d-813f8dff91af tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] HTTP exception thrown: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. Nov 09 10:35:32.842860 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b1b24f9d-a569-49d7-9c1d-813f8dff91af tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Returning 404 to user: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:35:32.843961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b1b24f9d-a569-49d7-9c1d-813f8dff91af tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 404 len: 109 microversion: 2.1 time: 0.062587 Nov 09 10:35:32.848666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 22/44] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:32 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:35:32.858665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c0d79421-458f-4285-ac14-d07049d0dd44 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddbeb0d0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:32.928556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-c0d79421-458f-4285-ac14-d07049d0dd44 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] HTTP exception thrown: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. Nov 09 10:35:32.929175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c0d79421-458f-4285-ac14-d07049d0dd44 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Returning 404 to user: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:35:32.931849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c0d79421-458f-4285-ac14-d07049d0dd44 tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 404 len: 109 microversion: 2.1 time: 0.081310 Nov 09 10:35:32.935472 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 23/45] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:35:32 2021] DELETE /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:35:32.941456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d8960fca-1e1e-47b8-a8a2-736982dacd3b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Calling method '.version_select at 0x7f53ddac5ee0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:33.001902 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-d8960fca-1e1e-47b8-a8a2-736982dacd3b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] HTTP exception thrown: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. Nov 09 10:35:33.002997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d8960fca-1e1e-47b8-a8a2-736982dacd3b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] Returning 404 to user: Volume 8e1648d6-f119-431f-a762-5a4b1524f236 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:35:33.004044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d8960fca-1e1e-47b8-a8a2-736982dacd3b tempest-VolumesSnapshotsTestJSON-1296802805 tempest-VolumesSnapshotsTestJSON-1296802805-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236" status: 404 len: 109 microversion: 2.1 time: 0.067089 Nov 09 10:35:33.004740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 23/46] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:32 2021] GET /compute/v2.1/os-volumes/8e1648d6-f119-431f-a762-5a4b1524f236 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:35:33.279657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:33.280618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:33.289877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.289877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:33.289877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.290731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:33.434812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:33.443396 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ee589642-15d1-4aef-8d45-d79b54d329b7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1218 microversion: 2.1 time: 0.168890 Nov 09 10:35:33.444111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 24/47] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:33 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:33.639570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:33.640224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:33.671092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.686773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:33.690404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.694233 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:33.734871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:33.735629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:33.748053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.753374 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:33.756357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:33.760962 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:34.055170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:34.068953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d158adbf-558b-4c68-904e-feafe383aeca tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1273 microversion: 2.1 time: 0.338104 Nov 09 10:35:34.071571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 25/48] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:33 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:34.462826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:34.462826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:34.481940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:34.485053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:34.487807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:34.490678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:34.502358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:34.511571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4c35a334-21f0-4f6e-853f-8fcaefd37696 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.875824 Nov 09 10:35:34.515384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 24/49] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:33 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:34.879095 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:34.890893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-91f7cd93-b5cf-4121-828a-917aaf47e8e1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1282 microversion: 2.1 time: 0.434415 Nov 09 10:35:34.891614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 26/50] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:34 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1282 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:35.088648 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:35.089345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:35.103203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.126868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:35.126868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.126868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:35.318119 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:35.365400 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-56c4c4cb-0e4e-4f01-a72c-8ad50b4cea04 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1273 microversion: 2.1 time: 0.279629 Nov 09 10:35:35.366536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 25/51] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:35 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:35.562562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:35.562562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:35.568107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.571265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:35.574475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.575019 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:35.911915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:35.912663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:35.929089 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.929883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:35.930687 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:35.942817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:36.209339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:36.225272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-420127fe-0d53-4ae0-adfc-b3e135111138 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.697400 Nov 09 10:35:36.225913 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 27/52] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:35 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:36.413701 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:36.421634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:36.433311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:36.449804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3d79f535-8d99-491d-9b0b-b2d1f431e8ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1280 microversion: 2.1 time: 0.542521 Nov 09 10:35:36.455032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 26/53] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:35 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1280 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:36.471075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:36.477552 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:36.481015 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:36.484803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:37.037885 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:37.037885 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-493dcce2-0f7b-4c11-b688-684e54526707 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.500672 Nov 09 10:35:37.037885 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 28/54] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:36 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:37.244460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:37.245123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:37.266824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:37.267474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:37.269060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:37.269807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:37.472304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:37.473109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:37.482592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:37.495053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:37.497642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:37.498210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:38.064652 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:38.093842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e7526cd4-5a37-4b86-9d95-c6491187b92c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.847565 Nov 09 10:35:38.094743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 27/55] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:37 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:38.105066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:38.108215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:38.141576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:38.142298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:38.143110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:38.143729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:38.541257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:38.548668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-42676db6-f280-45a5-a27c-aa9f7babee14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 1.080265 Nov 09 10:35:38.559872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 29/56] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:37 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:39.187890 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-a942f6fa-5d0e-4f7c-8b8d-778b0419e4cc req-fbe38bbe-adcf-4b5b-b1f4-21eb31f352c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4625928f-8448-4d86-b1e6-28b6c5ddac57", "tag": "3efed32a-8fe2-427e-9ada-fdc0f5a9c188"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:39.191353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:39.191353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:35:39.203892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:39.232485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-884818a2-7abb-4b4b-98d2-d80d22c42747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 1.116323 Nov 09 10:35:39.232605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-a942f6fa-5d0e-4f7c-8b8d-778b0419e4cc req-fbe38bbe-adcf-4b5b-b1f4-21eb31f352c0 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.232605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-a942f6fa-5d0e-4f7c-8b8d-778b0419e4cc req-fbe38bbe-adcf-4b5b-b1f4-21eb31f352c0 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.233108 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 28/57] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:38 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:39.239802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:39.240634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:39.250409 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.259664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.261013 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.263702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.277704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-a942f6fa-5d0e-4f7c-8b8d-778b0419e4cc req-fbe38bbe-adcf-4b5b-b1f4-21eb31f352c0 service nova] Creating event network-changed:3efed32a-8fe2-427e-9ada-fdc0f5a9c188 for instance 4625928f-8448-4d86-b1e6-28b6c5ddac57 on hv-cinder-81662 Nov 09 10:35:39.278240 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-a942f6fa-5d0e-4f7c-8b8d-778b0419e4cc req-fbe38bbe-adcf-4b5b-b1f4-21eb31f352c0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 10:35:39.285577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.287191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.288534 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.373263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.373263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.compute.rpcapi [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 10:35:39.373263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] Releasing lock "compute-rpcapi-router" {{(pid=122672) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 10:35:39.373263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ef533916-5ae9-4739-a530-1f780ee927db None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305753 Nov 09 10:35:39.373263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:39.567519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:39.569017 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:39.582201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.583074 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.584083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:39.587275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:39.866080 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:39.887122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9d865655-557b-436f-9672-75f3a0a82ab9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.652277 Nov 09 10:35:39.887819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 29/59] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:39 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:40.048637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:40.056678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-57c2d833-76cb-4c4b-8ebe-17c7f2e57071 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.493530 Nov 09 10:35:40.060325 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 31/60] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:39 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:40.240279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:40.241067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:40.259069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:40.259512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:40.260344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:40.260780 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:40.504367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e4ecb195-813c-4ae0-8f55-d53d1f85ac05 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Action: 'create', calling method: .version_select at 0x7f53ddac4160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-676773551", "metadata": {"Type": "work"}}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:40.957520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:40.967188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-31c54c2c-7ca0-4943-80e9-8718f73ac6c4 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.731266 Nov 09 10:35:40.970732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 30/61] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:40 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:40.977923 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:40.978790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:40.994870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.000273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.000273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.000273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.456346 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:41.465450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1e6d7333-c8d4-472b-aa85-f72d5d9398c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.493420 Nov 09 10:35:41.467583 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 31/62] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:40 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:41.764378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-75b75665-fd9c-4f69-9717-4923540c53f8 req-c936586a-0317-49ec-9a0e-f8754fc06b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c07487-72bd-4c21-8d60-f4bbce7fba5a", "tag": "5b4082fe-5c36-4667-a041-200e50fb0ba6"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:41.764378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:41.764378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:41.764378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-75b75665-fd9c-4f69-9717-4923540c53f8 req-c936586a-0317-49ec-9a0e-f8754fc06b98 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.764378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-75b75665-fd9c-4f69-9717-4923540c53f8 req-c936586a-0317-49ec-9a0e-f8754fc06b98 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.765861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-75b75665-fd9c-4f69-9717-4923540c53f8 req-c936586a-0317-49ec-9a0e-f8754fc06b98 service nova] Creating event network-changed:5b4082fe-5c36-4667-a041-200e50fb0ba6 for instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a on hv-cinder-81662 Nov 09 10:35:41.765861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-75b75665-fd9c-4f69-9717-4923540c53f8 req-c936586a-0317-49ec-9a0e-f8754fc06b98 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 09 10:35:41.765861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.765861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.765861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.766521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.766521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.compute.rpcapi [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 09 10:35:41.766521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] Releasing lock "compute-rpcapi-router" {{(pid=122673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 09 10:35:41.789241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-29e782b0-8698-4658-8b1c-cc2aebaec755 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318924 Nov 09 10:35:41.789747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 32/63] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:41.795495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:41.796102 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:41.808077 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.808719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.809500 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:41.809935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:41.972957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:41.983389 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2e63e05f-44c5-4c11-b052-8e2491638771 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.192196 Nov 09 10:35:42.010156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 33/64] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:41 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:42.035240 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-d4bbab37-a940-4e2b-a60c-48836a8f3852 req-6b1d4093-ea01-4df8-98d9-3f29dd865d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08913c05-333d-4287-b2b0-135fd053ca64", "tag": "2182bd85-9c95-41fc-b98c-a0f7b03dc613"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-d4bbab37-a940-4e2b-a60c-48836a8f3852 req-6b1d4093-ea01-4df8-98d9-3f29dd865d2b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-d4bbab37-a940-4e2b-a60c-48836a8f3852 req-6b1d4093-ea01-4df8-98d9-3f29dd865d2b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-d4bbab37-a940-4e2b-a60c-48836a8f3852 req-6b1d4093-ea01-4df8-98d9-3f29dd865d2b service nova] Creating event network-changed:2182bd85-9c95-41fc-b98c-a0f7b03dc613 for instance 08913c05-333d-4287-b2b0-135fd053ca64 on hv-cinder-81662 Nov 09 10:35:42.098151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-d4bbab37-a940-4e2b-a60c-48836a8f3852 req-6b1d4093-ea01-4df8-98d9-3f29dd865d2b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079964 Nov 09 10:35:42.100917 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 34/65] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:42.111584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:42.115909 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:42.126342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:42.127639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:42.129811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:42.132879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:42.159761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e4ecb195-813c-4ae0-8f55-d53d1f85ac05 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.863555 Nov 09 10:35:42.160785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 32/66] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Nov 9 10:35:40 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1865 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 09 10:35:42.166670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-251653823", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34358316-6aa9-484d-bebb-9653f7b5c623"}], "security_groups": [{"name": "tempest-securitygroup--2117517572"}], "key_name": "tempest-keypair-76977645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:42.421076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:42.431355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-175db0f7-6319-4339-9275-11891afb08ef tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.330772 Nov 09 10:35:42.433306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 35/67] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:42 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:42.449162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bade9dcd-15a5-4f04-bc99-0c00919ced64 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53ddb2d550>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:42.488101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] validate_networks() for [('34358316-6aa9-484d-bebb-9653f7b5c623', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:42.722591 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bade9dcd-15a5-4f04-bc99-0c00919ced64 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 200 len: 352 microversion: 2.1 time: 0.288214 Nov 09 10:35:42.724947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 36/68] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:42 2021] GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:42.731195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:42.732864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:42.756411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:42.759074 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:42.764042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:42.770470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.009217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.020312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1e7d8c5f-b0ef-4baa-bcc9-cca10b2d17be tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.293511 Nov 09 10:35:43.021224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 37/69] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:42 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:43.037755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:43.041078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:43.048475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.063776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.063776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.063776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.083299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:43.083724 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:43.084277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:43.084727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:43.085248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:43.095543 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.096046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.096856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.097358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.118431 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:43.123344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:43.141065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:43.144558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:43.265153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.265153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4abe1097-3516-4be3-b31a-7193b700b415 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.204489 Nov 09 10:35:43.265153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 38/70] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:43 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:43.451582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:43.452614 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:43.459436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.460194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.461175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.461828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.633159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.640984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4ac968d7-6f3f-4f9f-a801-ee48acaacc8a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.193432 Nov 09 10:35:43.641683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 39/71] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:43 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:43.736030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6f4c355a-16ed-4e92-830f-7c74ce63a227 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53ddac5820>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:43.747206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d2b734ca-dd5d-4eeb-9797-1bc33ea9f405 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.585289 Nov 09 10:35:43.748427 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 33/72] 10.222.0.35 () {62 vars in 1187 bytes} [Tue Nov 9 10:35:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 09 10:35:43.760722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:43.761501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:43.813292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6f4c355a-16ed-4e92-830f-7c74ce63a227 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 200 len: 353 microversion: 2.1 time: 0.080737 Nov 09 10:35:43.813958 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 40/73] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:43 2021] GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:43.825232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-191a928e-552e-4e4e-aac6-96d73b868cf4 req-7846bfac-0ed2-4751-b715-40afc746d1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a60a22-2f2e-4979-b8e2-b12a2e7bf671", "tag": "2bbca5fa-0081-4df3-bbdb-1ebc76058527"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:43.826837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:43.826837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:43.834960 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-191a928e-552e-4e4e-aac6-96d73b868cf4 req-7846bfac-0ed2-4751-b715-40afc746d1c6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:43.836773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-191a928e-552e-4e4e-aac6-96d73b868cf4 req-7846bfac-0ed2-4751-b715-40afc746d1c6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:43.857437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-191a928e-552e-4e4e-aac6-96d73b868cf4 req-7846bfac-0ed2-4751-b715-40afc746d1c6 service nova] Creating event network-changed:2bbca5fa-0081-4df3-bbdb-1ebc76058527 for instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 on hv-cinder-81662 Nov 09 10:35:43.862534 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.863161 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-191a928e-552e-4e4e-aac6-96d73b868cf4 req-7846bfac-0ed2-4751-b715-40afc746d1c6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041632 Nov 09 10:35:43.863771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 41/74] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:43.871236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.873119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:43.874271 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1cfd6bd3-0737-412c-86d6-6c234ff2213d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1279 microversion: 2.20 time: 0.118201 Nov 09 10:35:43.874837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 34/75] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:43 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:43.890718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d090a3e9-60b8-4d6b-840e-27a30b607cf5 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53dda93a60>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.038385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.039109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:44.051858 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.052357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.053152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.053595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.060946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d090a3e9-60b8-4d6b-840e-27a30b607cf5 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 200 len: 353 microversion: 2.1 time: 0.195877 Nov 09 10:35:44.061627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 42/76] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:43 2021] GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:44.080317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ee7d3b5e-9e9e-4168-84fc-6d8127eaaa0c tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53dda931f0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.209357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.217610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-78e04aeb-31fd-4b56-8f73-707bf0daf4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.182995 Nov 09 10:35:44.218515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 35/77] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:44 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:44.309103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.311331 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:44.318569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.319034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.319832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.320713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.466004 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.474431 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7ddf92c1-1255-4fa6-8932-d465b26c3f07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.170055 Nov 09 10:35:44.475516 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 36/78] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:44 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:44.687754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.687754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:44.687754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.687754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.689088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:44.689088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:44.728975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ee7d3b5e-9e9e-4168-84fc-6d8127eaaa0c tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 202 len: 0 microversion: 2.1 time: 0.652006 Nov 09 10:35:44.730095 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 43/79] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:35:44 2021] DELETE /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:35:44.741336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-04f5833e-d615-4dec-934d-94a66b2f4e64 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53dda75a60>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.824701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-04f5833e-d615-4dec-934d-94a66b2f4e64 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 200 len: 352 microversion: 2.1 time: 0.090410 Nov 09 10:35:44.831389 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 44/80] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:44 2021] GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:44.868747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.876078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4f83d097-7499-4763-bfb6-9090796d5f6e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.216767 Nov 09 10:35:44.878584 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 37/81] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:44 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:44.894959 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:44.895871 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:44.955341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.963268 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.965736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:44.967669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8b1617a4-9d76-4ac9-b4c8-6e3de4509e11 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1279 microversion: 2.20 time: 0.078093 Nov 09 10:35:44.969070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 45/82] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:44 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1279 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:45.243276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:45.244317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:45.253426 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.253886 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:45.254686 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.255129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:45.488111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:45.493402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:45.493930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:45.496568 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-14cfeb08-c3c7-481e-bce8-762a92a31bfc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.258305 Nov 09 10:35:45.497389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 38/83] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:45 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:45.510043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.510373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:45.512205 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.512646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:45.680590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:45.685503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c8d8395b-72d7-441a-abc5-cf2d70762189 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.197475 Nov 09 10:35:45.686073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 46/84] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:45 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:45.837750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3640a911-fc8f-4fed-90c0-e0f90f0dc577 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Calling method '.version_select at 0x7f53ddb189d0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:45.893736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:45.894375 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:45.904399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.908693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:45.908693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:45.908693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.083410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-3640a911-fc8f-4fed-90c0-e0f90f0dc577 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] HTTP exception thrown: Volume 2bb2a519-8c45-45f4-8d83-a2556043c4d9 could not be found. Nov 09 10:35:46.085089 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3640a911-fc8f-4fed-90c0-e0f90f0dc577 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] Returning 404 to user: Volume 2bb2a519-8c45-45f4-8d83-a2556043c4d9 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:35:46.087118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3640a911-fc8f-4fed-90c0-e0f90f0dc577 tempest-VolumesGetTestJSON-2141736060 tempest-VolumesGetTestJSON-2141736060-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9" status: 404 len: 109 microversion: 2.1 time: 0.253076 Nov 09 10:35:46.087896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 39/85] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:35:45 2021] GET /compute/v2.1/os-volumes/2bb2a519-8c45-45f4-8d83-a2556043c4d9 => generated 109 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:35:46.096324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:46.096979 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:46.104471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.105452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.107560 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.108207 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.139765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:46.144891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b07f2c51-1f90-4962-b5a8-85a79783067c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.254705 Nov 09 10:35:46.145883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 47/86] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:45 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:46.248093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:46.256847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:46.259271 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:46.260741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-75865170-9611-422b-9f15-eb61aff9dc74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1283 microversion: 2.20 time: 0.171432 Nov 09 10:35:46.272686 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 40/87] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:46 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:46.514773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:46.515384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:46.524139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.524809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.525757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.526332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.708959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:46.710357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:46.718099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.718827 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:46.719786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:46.720477 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:47.029986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.037510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-82620a06-e0f5-4642-9e6b-26ca64209a2f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.526584 Nov 09 10:35:47.038088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 48/88] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:46 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:47.162190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:47.162983 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:47.177430 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:47.180092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:47.180092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:47.180092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:47.461653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.473990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-47eb958c-8498-4916-8ebc-990c697bcd3a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.773695 Nov 09 10:35:47.477825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 41/89] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:46 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:47.492533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:47.495573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:47.506556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:47.506556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:47.506556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:47.506556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:47.647498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.664603 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.667561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.669133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5a120328-7292-4b1d-8305-db9f54f33a36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1331 microversion: 2.20 time: 0.188899 Nov 09 10:35:47.670636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 42/90] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:47 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:47.681670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:47.689844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cfb5a144-867b-42cd-a9c7-f197ef948d40 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.530962 Nov 09 10:35:47.690421 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 49/91] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:47 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:48.054033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:48.055230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:48.067724 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.068195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.069444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.070124 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.504799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:48.508669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:48.508669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:48.516922 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6073ddec-e0ef-4a7c-a7a5-c8bc87b1c4eb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.464775 Nov 09 10:35:48.521476 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 43/92] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:48 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:48.521662 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.522351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.523298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.524418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.687440 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:48.688211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:48.695037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.695549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.696372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.696806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.775959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:48.790051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:48.792904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:48.794633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e8350d48-77a8-4013-bbb9-caeedae4eaa7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1337 microversion: 2.20 time: 0.111461 Nov 09 10:35:48.796764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 44/93] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:48 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:35:48.802683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:48.803446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:48.813403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.813754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.814630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:48.815474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:48.913348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:48.928187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d864cb2a-08cd-4a46-a249-80d2d8e3cb74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.437554 Nov 09 10:35:48.939031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 50/94] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:48 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:49.018786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:49.026658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-486381c9-4944-48cf-9f83-e9de6e3047f8 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.228455 Nov 09 10:35:49.027232 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 45/95] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:48 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:49.538940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:49.540362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:49.546984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.547602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:49.548410 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.549217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:49.784524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:49.794896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cbe2632c-703f-4525-9032-d08c9a2f4197 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.261265 Nov 09 10:35:49.796896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 51/96] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:49 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:49.814708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:49.815342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:49.822760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.823212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:49.824011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.824607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:49.945501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:49.946777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:49.954281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.957112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:49.957773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:49.958286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:50.022567 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:50.040031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:50.041624 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:50.046197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-44df1d2a-a915-4398-8720-4662519ad171 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.233066 Nov 09 10:35:50.057719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 46/97] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:49 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:50.067186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:50.067808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:50.081456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:50.081906 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:50.082698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:50.083129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:50.289441 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:50.300911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d44c78c0-94a9-481b-b12b-e3c9481d8154 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.359122 Nov 09 10:35:50.301524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 52/98] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:49 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:50.309826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:50.318189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-964afc28-7cd2-4617-aa5a-1831c802735e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.259208 Nov 09 10:35:50.319126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 47/99] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:50 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:50.813516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:50.814750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:50.823195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:50.823896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:50.824912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:50.825510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.045298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:51.054677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-153bc9da-c2b4-4b2f-842a-98796194ede6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.244759 Nov 09 10:35:51.055561 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 53/100] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:50 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:51.071642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:51.071642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:51.073853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.074557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.078131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.082845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.232911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-5f8495d6-056d-4e2a-9781-69e89957db12 req-2ca178c8-f1c5-45e1-a86b-0ca811072ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:51.235032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:51.235032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:51.251021 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-5f8495d6-056d-4e2a-9781-69e89957db12 req-2ca178c8-f1c5-45e1-a86b-0ca811072ade service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.252892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-5f8495d6-056d-4e2a-9781-69e89957db12 req-2ca178c8-f1c5-45e1-a86b-0ca811072ade service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.276934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-5f8495d6-056d-4e2a-9781-69e89957db12 req-2ca178c8-f1c5-45e1-a86b-0ca811072ade service nova] Creating event network-changed:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:35:51.290477 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-5f8495d6-056d-4e2a-9781-69e89957db12 req-2ca178c8-f1c5-45e1-a86b-0ca811072ade service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058558 Nov 09 10:35:51.291625 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 54/101] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:51.324776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:51.325505 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:51.358248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.360028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.360028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.360028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.600486 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:51.609131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:51.610887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:51.612312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-98dedc3c-ef8f-433c-ac00-7e08617fbd21 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.551669 Nov 09 10:35:51.624383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 48/102] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:51 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:51.630893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:51.631771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:51.640277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.640882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.641836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:51.642416 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:51.789588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:51.800746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-75437a46-8a58-4fbb-8e5d-a9b7ef635c14 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.486970 Nov 09 10:35:51.803493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 55/103] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:51 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:52.020131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:52.031003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-104c40c7-af5e-4b4f-8fcb-8c4152a31747 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.403741 Nov 09 10:35:52.032143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 49/104] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:51 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:52.084732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:52.085342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:52.091843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.093433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.094233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.094845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.341621 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:52.356019 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-00c6a006-8091-471b-8f31-71e4bf5c7b42 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.280344 Nov 09 10:35:52.368299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 50/105] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:52 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:52.410425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-58a45cd9-0313-426a-93b7-e4e17bc0b179 req-ca2bf219-a9d4-4252-b357-b766102ce6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4625928f-8448-4d86-b1e6-28b6c5ddac57", "name": "network-vif-plugged", "status": "completed", "tag": "3efed32a-8fe2-427e-9ada-fdc0f5a9c188"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:52.412719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:52.412719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:52.423129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-58a45cd9-0313-426a-93b7-e4e17bc0b179 req-ca2bf219-a9d4-4252-b357-b766102ce6f6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.429903 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-58a45cd9-0313-426a-93b7-e4e17bc0b179 req-ca2bf219-a9d4-4252-b357-b766102ce6f6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.456907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-58a45cd9-0313-426a-93b7-e4e17bc0b179 req-ca2bf219-a9d4-4252-b357-b766102ce6f6 service nova] Creating event network-vif-plugged:3efed32a-8fe2-427e-9ada-fdc0f5a9c188 for instance 4625928f-8448-4d86-b1e6-28b6c5ddac57 on hv-cinder-81662 Nov 09 10:35:52.470452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-58a45cd9-0313-426a-93b7-e4e17bc0b179 req-ca2bf219-a9d4-4252-b357-b766102ce6f6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453845 Nov 09 10:35:52.471460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 56/106] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:52.630743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:52.631370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:52.644500 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.644992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.646022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.646619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.825029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:52.826082 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:52.854834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.856141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.857581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:52.869634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:52.869935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:52.879324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:52.881146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:52.883694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9defbd31-4e0c-4562-9256-32ccbdfc0ccf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.256938 Nov 09 10:35:52.884515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 51/107] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:52 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:53.050678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:53.051284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:53.071893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.072387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:53.080801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.082871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:53.151259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:53.160477 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-df782ba0-7ed4-434d-9ec8-dc87de8df431 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.341752 Nov 09 10:35:53.167286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 57/108] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:52 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:53.359661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:53.371768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0d914194-4950-430a-9a2e-bd0d369a8bc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.324538 Nov 09 10:35:53.373197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 52/109] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:53 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:53.374997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:53.375609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:53.388535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.389005 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:53.389781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.390210 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:53.602476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:53.609743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-667fccbc-88a3-41dd-9f0f-b754950dd619 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.238667 Nov 09 10:35:53.610316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 58/110] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:53 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:53.901882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:53.902487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:53.908650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.915049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:53.915049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:53.915049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.049725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.058363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.059867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.061003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8b3b4c9c-26c3-4123-94e2-ecf0d69a2050 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.162917 Nov 09 10:35:54.061550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 53/111] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:53 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:54.180724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:54.181718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:54.188087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.188529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.189389 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.189819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.325207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.338783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1040bd4f-fb46-4d5b-93fb-8044ec789656 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.162884 Nov 09 10:35:54.345989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 59/112] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:54 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:54.389987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:54.391770 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:54.402376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.402860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.403629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.405000 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.567954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.576366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-336c1fd5-7c3c-4bef-9d7c-39707aaa08f2 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.190902 Nov 09 10:35:54.577039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 54/113] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:54 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:54.626646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:54.627376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:54.634171 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.634765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.635395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:54.635859 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:54.970680 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:54.978702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2261ba97-36f3-4c25-b922-6f38546629e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1316 microversion: 2.1 time: 0.355875 Nov 09 10:35:54.982701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 60/114] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:54 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:55.078653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:55.079259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:55.085134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.085628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.086485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.086898 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.231382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:55.239802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:55.241528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:55.243110 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-91b8ab8e-7c7e-4b2f-b2d1-7154b467c9f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.168205 Nov 09 10:35:55.243669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 55/115] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:55 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:55.362022 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-93f3fa40-7c66-4086-9110-14c0540de5b8 req-e44dfda3-9177-4a03-8da4-69eb340f9c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08913c05-333d-4287-b2b0-135fd053ca64", "name": "network-vif-plugged", "status": "completed", "tag": "2182bd85-9c95-41fc-b98c-a0f7b03dc613"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:55.363853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:55.363853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:55.365058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:55.370643 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:55.376243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-93f3fa40-7c66-4086-9110-14c0540de5b8 req-e44dfda3-9177-4a03-8da4-69eb340f9c46 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.376904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-93f3fa40-7c66-4086-9110-14c0540de5b8 req-e44dfda3-9177-4a03-8da4-69eb340f9c46 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.378771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.379332 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.380214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.380882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.392608 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-93f3fa40-7c66-4086-9110-14c0540de5b8 req-e44dfda3-9177-4a03-8da4-69eb340f9c46 service nova] Creating event network-vif-plugged:2182bd85-9c95-41fc-b98c-a0f7b03dc613 for instance 08913c05-333d-4287-b2b0-135fd053ca64 on hv-cinder-81662 Nov 09 10:35:55.400857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-93f3fa40-7c66-4086-9110-14c0540de5b8 req-e44dfda3-9177-4a03-8da4-69eb340f9c46 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043017 Nov 09 10:35:55.401677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 61/116] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:35:55.553156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:55.553156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f5c5123b-901b-419b-8ac5-026ae8358fa1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.185610 Nov 09 10:35:55.553156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 56/117] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:55 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:55.595873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:55.596873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:55.603832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.604379 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.605417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:55.605777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:55.761909 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:55.774083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f9cdcaa3-33a0-4626-87cd-679ed3dbe9ac tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.182768 Nov 09 10:35:55.775066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 62/118] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:55 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:55.995760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:55.996411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:56.003232 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.003685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.004508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.004936 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.170165 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.178397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-49b1a83c-620b-4ba6-828d-01ebf805a177 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1506 microversion: 2.1 time: 0.186212 Nov 09 10:35:56.179081 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 57/119] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:55 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:56.262060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:56.263296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:56.270336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.271104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.272010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.272703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.430589 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.439029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.440517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.441727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1aa9d465-4de7-4a56-81a2-ea3890f01a89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.184055 Nov 09 10:35:56.442276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 63/120] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:56 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:56.568504 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:56.569142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:56.576069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.576520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.577293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.577903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.728423 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.736103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-583ae0a0-1fca-4f4f-b6a8-24653d2ac1d0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1322 microversion: 2.1 time: 0.171382 Nov 09 10:35:56.736669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 58/121] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:56 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:56.792057 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:56.792703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:56.798655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.799127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.799893 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:56.800341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:56.958024 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:56.965447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6c7b6446-1272-481f-bf77-31824aedaff1 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.178610 Nov 09 10:35:56.966032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 64/122] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:56 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:57.161540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1070467695", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:57.233290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] validate_networks() for None {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:35:57.424122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c07487-72bd-4c21-8d60-f4bbce7fba5a", "name": "network-vif-plugged", "status": "completed", "tag": "5b4082fe-5c36-4667-a041-200e50fb0ba6"}, {"server_uuid": "63a60a22-2f2e-4979-b8e2-b12a2e7bf671", "name": "network-vif-plugged", "status": "completed", "tag": "2bbca5fa-0081-4df3-bbdb-1ebc76058527"}, {"server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "name": "network-vif-plugged", "status": "completed", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:57.436629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:35:57.436629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:35:57.440857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.441629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.461010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Creating event network-vif-plugged:5b4082fe-5c36-4667-a041-200e50fb0ba6 for instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a on hv-cinder-81662 Nov 09 10:35:57.461569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Creating event network-vif-plugged:2bbca5fa-0081-4df3-bbdb-1ebc76058527 for instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 on hv-cinder-81662 Nov 09 10:35:57.462060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] Creating event network-vif-plugged:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:35:57.470298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-2e94aee1-8704-477d-9b0c-56f17393c448 req-b665dfb9-d9bd-4fad-a788-cb76c6b3844e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050042 Nov 09 10:35:57.471226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 65/123] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:35:57.476962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:57.477658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:57.484234 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.484681 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.485454 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.485883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.724606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:57.735835 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:57.738109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:57.739661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-24466968-9723-4297-80bb-8dc0845b0163 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.267500 Nov 09 10:35:57.740400 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 66/124] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:57 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:35:57.754431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:57.755829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:57.762659 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.763099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.763988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.764341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.818501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:35:57.819341 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:35:57.820408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:35:57.821253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:35:57.821833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:35:57.837245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.846295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.846295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.846295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.860533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Getting quotas for project 1d823ea16c394a2db96710191d5f5e23. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:35:57.864435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Getting quotas for user 227ceca813624a78b1d1e0f602d590c7 and project 1d823ea16c394a2db96710191d5f5e23. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:35:57.880115 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:35:57.892131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:35:57.947016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:57.955642 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a5cdd4f4-da68-4819-8793-5e7397b4d743 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1516 microversion: 2.1 time: 0.205118 Nov 09 10:35:57.956262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 67/125] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:57 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:57.973814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:57.974895 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:57.982391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.982837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:57.983629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:57.984084 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.051467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'flavor' on Instance uuid 08913c05-333d-4287-b2b0-135fd053ca64 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:35:58.072996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-81e6c919-cc85-47ce-af33-ad3018734b3a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915919 Nov 09 10:35:58.073654 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 59/126] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:35:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:35:58.092697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:58.092697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:58.106738 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.107515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.108545 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.108980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.298426 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.305681 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-babd3274-2da8-44bd-8959-27d19329cc01 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.220057 Nov 09 10:35:58.306502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 60/127] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:58 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:58.317120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6a1de3cc-cce5-4314-9b24-6b6163c64cce tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:58.317888 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6a1de3cc-cce5-4314-9b24-6b6163c64cce tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:58.388360 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6a1de3cc-cce5-4314-9b24-6b6163c64cce tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.395865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6a1de3cc-cce5-4314-9b24-6b6163c64cce tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1215 microversion: 2.1 time: 0.088199 Nov 09 10:35:58.401404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 61/128] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:58 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:58.449569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73eaf7fe-d953-4b3e-8d88-8b2369d02d6a"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:35:58.452996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:58.456520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.456958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.457725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.458168 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.491688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-49375591-90e5-49b4-a98c-eef436048b6b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64/action" status: 200 len: 32 microversion: 2.1 time: 0.521612 Nov 09 10:35:58.496704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 68/129] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:35:57 2021] POST /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64/action => generated 32 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:35:58.502466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:58.504734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:58.510894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.511442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.512481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.513017 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.662294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.669571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2968533b-1f6a-466d-9daf-131c17720fa2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.171055 Nov 09 10:35:58.670134 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 69/130] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:58 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:58.759552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:58.760299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:58.766058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.766485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.767258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:58.767718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:58.899784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.907832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.909451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:58.910573 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-578e6fec-2d49-4264-9044-9b5054db012f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.156114 Nov 09 10:35:58.911132 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 70/131] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:58 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:35:59.322558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:59.325725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:59.329093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.329535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.330298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.330722 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.466395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:59.473766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4c527c46-db56-4320-ba12-7a91325a242e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.154863 Nov 09 10:35:59.474331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 71/132] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:59 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:59.479186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:59.479779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:59.485397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.485834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.486649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.487071 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.557378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:59.565710 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-633dd142-2b34-42df-ab97-2a403a9e3213 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1219 microversion: 2.1 time: 0.090099 Nov 09 10:35:59.566402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 72/133] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:59 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:35:59.685879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:59.686518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:59.692374 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.692817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.693577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.694010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.828488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:35:59.837709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-98288b83-1a68-463f-b578-c6d010bd305f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.155203 Nov 09 10:35:59.838302 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 73/134] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:35:59 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:35:59.929871 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:35:59.930479 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:35:59.936647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.937470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:35:59.937851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:35:59.938271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.070634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:00.078650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:00.080200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:00.081319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9211e7e7-c969-441a-ae12-0792ec3a6726 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.156350 Nov 09 10:36:00.081870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 74/135] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:35:59 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:36:00.490724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:00.491376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:00.498323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.498762 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.499524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.499945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.667116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:00.678373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9f10f74a-a86d-46d7-812e-6efe44ac068a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.191072 Nov 09 10:36:00.682912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 75/136] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:00 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:00.684838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:00.685427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:00.693446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.693902 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.694643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.695154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.772606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:00.779910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-74da0d16-2fa3-4dfc-af66-8fe34b67979d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1219 microversion: 2.1 time: 0.098788 Nov 09 10:36:00.780617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 76/137] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:00 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:00.855043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:00.855701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:00.861646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.862091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.862869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:00.863319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:00.999371 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.007522 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c42b8581-8217-4301-9aca-174e15632be9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.156679 Nov 09 10:36:01.008159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 77/138] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:00 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:01.099046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:01.099719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:01.119842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.119842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.119842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.119842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.241742 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.249942 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.251444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.252572 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-be0f684a-f505-4122-9c1b-09dfe9cbd4e4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.157251 Nov 09 10:36:01.253139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 78/139] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:01 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:36:01.697182 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:01.697935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:01.704206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.704650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.705417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.705841 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.855907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.868364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c09cba73-99d2-49a9-8b39-894888cc4ace tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.175551 Nov 09 10:36:01.868954 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 79/140] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:01 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:01.883326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:01.883326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:01.888770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.889383 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.890229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:01.890725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:01.963492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:01.973009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f37475c7-a96f-456b-8d6c-65ed75ded355 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1219 microversion: 2.1 time: 0.102982 Nov 09 10:36:01.973601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 80/141] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:01 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:02.024991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:02.025669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:02.031979 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.032508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.033352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.033858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.184907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:02.193645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-04e3a7fc-ab5b-40ff-be95-ef5e0ca01f3b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.172568 Nov 09 10:36:02.194231 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 81/142] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:02 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:02.270525 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:02.271121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:02.277228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.277668 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.278425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.278855 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.510892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:02.518938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:02.520970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:02.522202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9df6baa6-2118-4d75-882a-651554b6c71e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.255399 Nov 09 10:36:02.523469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 82/143] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:02 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:36:02.603134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f54f2c91-7797-4f5d-b587-420004c7d014 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.157082 Nov 09 10:36:02.603731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 62/144] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:35:58 2021] POST /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments => generated 194 bytes in 4159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:36:02.885511 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:02.889049 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:02.892058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.892497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.893247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.894657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.989980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:02.990660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:02.996886 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.997326 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:02.998361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:02.998788 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:03.038721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.046437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4f5020d4-0dd1-4cca-9769-f6cfd10ea94d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.165004 Nov 09 10:36:03.053811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 83/145] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:02 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:03.069551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.077267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7d40f163-0993-4dd0-a424-4449049aef14 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1211 microversion: 2.1 time: 0.091828 Nov 09 10:36:03.077831 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 63/146] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:02 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:03.212466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:03.213064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:03.218899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:03.219346 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:03.220164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:03.220574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:03.362209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.379995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f1cf29a7-2926-441e-94c2-c4d757dcde1f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.162489 Nov 09 10:36:03.379995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 84/147] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:03 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:03.540786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:03.541401 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:03.547774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:03.548242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:03.549119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:03.549558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:03.694485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.703730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.705607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:03.713018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b330c9f6-3287-46d5-8861-84624048c43e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.176101 Nov 09 10:36:03.713621 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 64/148] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:03 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:36:04.062802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:04.063447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:04.069241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.069691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.071099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.071533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.094969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:04.096105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:04.113446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.113989 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.114874 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.115418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.177203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.186635 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-40714651-f35a-404c-bf10-778fb5e7f271 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1211 microversion: 2.1 time: 0.095608 Nov 09 10:36:04.188022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 65/149] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:04 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:04.217354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.224286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-047a127f-4f01-4c33-aaa0-2dbeebb923ce tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.165036 Nov 09 10:36:04.224853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 85/150] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:04 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:04.394315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:04.394984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:04.400690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.401140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.401919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.402385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.544377 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.551716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9897e2e3-36d1-4658-bd3a-20f567e424da tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.161189 Nov 09 10:36:04.555617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 66/151] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:04 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:04.731101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:04.731728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:04.737953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.738332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.739093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:04.739936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:04.878810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.888573 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.890085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:04.891194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-17155089-280f-4394-867b-5c35df9842f6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.163851 Nov 09 10:36:04.891778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 86/152] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:04 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:36:05.204145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:05.205263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:05.212528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.213015 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.213734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.214374 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.243413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:05.251611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:05.262299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.262736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.269355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.269969 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.306672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:05.315878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c49888c7-0b45-4151-b288-10ee0dbcae38 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1211 microversion: 2.1 time: 0.115544 Nov 09 10:36:05.316743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 67/153] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:05 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:05.430149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:05.437732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cfd259dd-d720-4fae-97df-4fb628f65278 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1315 microversion: 2.1 time: 0.200469 Nov 09 10:36:05.438307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 87/154] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:05 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:05.572589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:05.573454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:05.580565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.580986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.581819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.582278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.735471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:05.744304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c6cd0a06-f578-4c77-87f3-943944c4ef3f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.177026 Nov 09 10:36:05.758144 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 68/155] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:05 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:05.909689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:05.914174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:05.916780 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.917225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:05.917996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:05.918422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.057571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.066191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.067736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.068870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e5693b02-c2bc-47ae-af7e-3d7650a87ff2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1405 microversion: 2.20 time: 0.162894 Nov 09 10:36:06.069550 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 88/156] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:05 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:36:06.333166 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:06.333777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:06.340463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.340980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.341993 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.343274 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.415142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.422915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2cfe9de-600b-4945-8773-e0c8ad998af3 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1267 microversion: 2.1 time: 0.093761 Nov 09 10:36:06.423601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 69/157] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:06 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:06.455259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:06.456042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:06.466567 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.467010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.468076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.468510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.683444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.695134 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1402e52a-602b-4dd6-ab3a-0b5019413ed0 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1502 microversion: 2.1 time: 0.243928 Nov 09 10:36:06.696109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 89/158] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:06 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:06.761120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:06.761734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:06.767774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.768575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.769571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:06.770283 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:06.963206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:06.970551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-319a72f2-2af5-4f96-b0f2-db759b09fec8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.213100 Nov 09 10:36:06.980490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 70/159] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:06 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:07.086912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:07.093711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:07.093711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.093711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.094423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.094847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.255393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:07.291641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:07.297864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:07.299100 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7d223252-b3de-42f5-bc76-d001bdf37fd5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1596 microversion: 2.20 time: 0.216432 Nov 09 10:36:07.299905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 90/160] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:36:07 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1596 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:36:07.319093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:07.320389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:07.327335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.328159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.329827 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.330590 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.440894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:07.441516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:07.449751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.450191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.456461 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:07.457805 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:07.483243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-015d9668-bfed-4298-8b62-40e3fd2734df tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165500 Nov 09 10:36:07.483243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 71/161] 10.222.0.35 () {60 vars in 1315 bytes} [Tue Nov 9 10:36:07 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:36:07.612531 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:07.625814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1c9770b6-5e6a-4373-a8bd-cea7695a7f28 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1273 microversion: 2.1 time: 0.187770 Nov 09 10:36:07.626485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 91/162] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:07 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:08.015526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:08.015526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:08.015526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.015526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.018083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.018083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.219671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:08.228810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-abda0252-df43-46cd-a68d-be8392527e71 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.244190 Nov 09 10:36:08.234543 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 72/163] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:07 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:08.643937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:08.644558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:08.650548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.650988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.651761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.652730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.788695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "003a1283-1c26-46f0-8f8c-869f24fc81c8"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:08.790631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:08.801242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.804845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.805797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:08.807411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:08.940060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:08.952383 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2f10ba13-7d51-4032-96a3-78b69da5f3d8 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.312205 Nov 09 10:36:08.953787 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 92/164] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:08 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:09.134088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-4fac3621-abee-4871-91e4-ebecc28bab07 req-94e494c0-e884-4360-99cf-743edbfb4a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f4033-0246-4cb7-bc44-78fc79681448", "tag": "73f6a0f3-79c3-4d4c-ae34-908c44ee3b50"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:09.139643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:09.139643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:09.144002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-4fac3621-abee-4871-91e4-ebecc28bab07 req-94e494c0-e884-4360-99cf-743edbfb4a09 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.144439 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-4fac3621-abee-4871-91e4-ebecc28bab07 req-94e494c0-e884-4360-99cf-743edbfb4a09 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.162522 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-4fac3621-abee-4871-91e4-ebecc28bab07 req-94e494c0-e884-4360-99cf-743edbfb4a09 service nova] Creating event network-changed:73f6a0f3-79c3-4d4c-ae34-908c44ee3b50 for instance 2b7f4033-0246-4cb7-bc44-78fc79681448 on hv-cinder-81662 Nov 09 10:36:09.169593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-4fac3621-abee-4871-91e4-ebecc28bab07 req-94e494c0-e884-4360-99cf-743edbfb4a09 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039495 Nov 09 10:36:09.171188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 93/165] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:36:09.248635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:09.249224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:09.263634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.264532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.265713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.266312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.573696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:09.582150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-47116bad-aa46-47dc-a18d-d450cc435baf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.338559 Nov 09 10:36:09.582669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 94/166] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:09 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:09.587663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:09.588883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:09.595045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.595750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.596767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.597385 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.718567 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f1224e91-5f19-44d2-9eab-50f3e5d3e1a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.134439 Nov 09 10:36:09.720134 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 95/167] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:09 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:09.725540 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-24c4cbbe-8ad8-40b0-b355-22ae70e107f6 req-020c2240-ed86-481b-8c38-f6429dc05476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:09.728315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:09.728315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:09.748189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-24c4cbbe-8ad8-40b0-b355-22ae70e107f6 req-020c2240-ed86-481b-8c38-f6429dc05476 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:09.750470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-24c4cbbe-8ad8-40b0-b355-22ae70e107f6 req-020c2240-ed86-481b-8c38-f6429dc05476 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:09.770802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-24c4cbbe-8ad8-40b0-b355-22ae70e107f6 req-020c2240-ed86-481b-8c38-f6429dc05476 service nova] Creating event network-changed:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:36:09.777018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-24c4cbbe-8ad8-40b0-b355-22ae70e107f6 req-020c2240-ed86-481b-8c38-f6429dc05476 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055245 Nov 09 10:36:09.777975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 96/168] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:09.830581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-54d81947-d7e9-4182-863d-a0e5136fd032 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "POST /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047543 Nov 09 10:36:09.832850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 73/169] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:36:08 2021] POST /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a/os-volume_attachments => generated 194 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:09.977600 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:09.978497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:10.008759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.011583 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.013880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.014539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.302706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:10.316518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0f6e9407-796d-47ee-bd78-ceea3f4b59af tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.345568 Nov 09 10:36:10.331735 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 97/170] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:09 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:10.601934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:10.603674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:10.612736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.613610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.615848 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.616443 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.730991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:10.736271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:10.740479 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.741148 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.742956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:10.743573 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:10.779472 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:10.787939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7060d1cf-835d-4f19-859c-a0e8a9cffd07 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.191269 Nov 09 10:36:10.788568 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 74/171] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:10 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:10.838169 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4a0e7eb3-2c1a-47e6-b1e1-375e969fc596 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.111767 Nov 09 10:36:10.838927 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 98/172] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:10 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:11.338185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:11.338709 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:11.344673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.345119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.345880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.346312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.489671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:11.497824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5f8731a0-c993-4703-9ced-93b4f17489ff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.163095 Nov 09 10:36:11.498397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 75/173] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:11 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:11.805532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:11.806321 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:11.817200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.817200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.817200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.817200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.849367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:11.850259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:11.858002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.858462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.859260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:11.859990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:11.956849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6cc12fb5-c203-49fe-b4e4-03cdd1739648 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.111034 Nov 09 10:36:11.957921 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 76/174] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:11 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:11.961970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:11.969898 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f6934995-8fd7-475f-a7d1-78d440b1ff09 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.168333 Nov 09 10:36:11.978009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 99/175] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:11 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:12.514575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:12.515542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:12.522090 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:12.522536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:12.523315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:12.523757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:12.656719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:12.665106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-653c2f93-9f48-463e-84c8-f3d33ca32f37 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.154504 Nov 09 10:36:12.665670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 77/176] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:12 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:12.967736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:12.968669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:12.974937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:12.975376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:12.976690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:12.977121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:12.992679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:12.993441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:12.999857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:13.000335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:13.001112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:13.001658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:13.062324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6fd06189-0516-4b64-8f6c-1fdb592e1cc3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.098123 Nov 09 10:36:13.062962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 100/177] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:12 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:13.141682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:13.149449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1a29782f-af67-48e2-aa3a-1555131e15ad tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.161089 Nov 09 10:36:13.150018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 78/178] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:12 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:13.686909 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:13.687618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:13.695260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:13.695932 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:13.696889 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:13.697366 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:13.838300 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:13.853008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c48c2a51-155c-449e-bba5-1ccf1dfc3aff tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.172033 Nov 09 10:36:13.853008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 101/179] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:13 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:14.080080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:14.080080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:14.082729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.083247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:14.084050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.084494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:14.166779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:14.167368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3f018b61-ccda-4c7f-960a-0ea2e96f73f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.097122 Nov 09 10:36:14.167480 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:14.168017 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 79/180] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:14 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:14.173679 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.174116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:14.174876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.175324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:14.307061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:14.315545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-05ab624d-f4e3-404c-b046-8d4f97f2ed26 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.152832 Nov 09 10:36:14.321210 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 102/181] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:14 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:14.868955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:14.869644 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:14.883143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.883614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:14.884496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:14.884918 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.027359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:15.035902 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7bd5d633-a099-4a7f-be6f-364a96cf771b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.171432 Nov 09 10:36:15.036719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 80/182] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:14 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:15.041528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1340782306", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "5554d1a8-4766-4ee1-bd4f-871198ca55f6"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:15.092684 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] validate_networks() for [('5554d1a8-4766-4ee1-bd4f-871198ca55f6', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:36:15.178919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:15.179819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:15.185744 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.187714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.187714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.187714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.261265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ac6ca914-ebd3-44d9-84e2-d42c1ff40294 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.086222 Nov 09 10:36:15.264988 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 81/183] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:15 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:15.335093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:15.335917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:15.343600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.347629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.347629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.347629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.475040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:36:15.477132 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:36:15.477734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:36:15.478247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:36:15.478693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:36:15.489585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:15.495477 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.496039 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.497104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:15.497974 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:15.503725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-223b38de-7a5c-4d98-9df5-fd2173abed91 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.172807 Nov 09 10:36:15.517778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 82/184] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:15 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:15.518075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:36:15.521563 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for user 1a255547966e430bac7a2b4d0c0727b1 and project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:36:15.534135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:36:15.536638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:36:15.756702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-831f0fa2-1006-4ac2-a444-feb60486a88f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715950 Nov 09 10:36:15.756702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 103/185] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:36:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:36:15.764375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-29a537e4-a2c9-4597-96ef-ac1a3e21764d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:15.765109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-29a537e4-a2c9-4597-96ef-ac1a3e21764d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:15.827490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-29a537e4-a2c9-4597-96ef-ac1a3e21764d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:15.836759 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-29a537e4-a2c9-4597-96ef-ac1a3e21764d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1218 microversion: 2.1 time: 0.075450 Nov 09 10:36:15.837335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 83/186] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:15 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:16.052588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:16.053410 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:16.059262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.059735 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.060530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.060956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.220314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:16.228518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-18fd6aeb-46e5-4ca6-98b7-7cf9c5f33560 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.179522 Nov 09 10:36:16.229065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 104/187] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:16 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:16.272730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:16.274268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:16.280537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.286002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.286002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.286002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.353792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-987c6d59-0f26-4b3b-88b0-bc784e4df61e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.084616 Nov 09 10:36:16.354425 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 84/188] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:16 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:16.532036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:16.538635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:16.548771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.549569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.550442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.550874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.725972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:16.734351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c5846b37-ba33-4f71-988f-429f554099d1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.212276 Nov 09 10:36:16.734949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 105/189] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:16 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:16.854124 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:16.854817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:16.870853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.871447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.873469 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:16.874052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:16.967946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:16.967946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-97312101-d413-4392-b2a2-e8997bcb1164 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1222 microversion: 2.1 time: 0.110844 Nov 09 10:36:16.967946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 85/190] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:16 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:17.245720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:17.246386 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:17.252804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.253244 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.254018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.254443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.364593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:17.365533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:17.372716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.373167 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.373947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.374377 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.387685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:17.398749 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-788637ec-e906-4a4a-a564-a9d7dfe7273d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.157257 Nov 09 10:36:17.399335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 106/191] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:17 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:17.461567 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2545bb8-cb51-47fa-9f48-5ca97d4a7729 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.097488 Nov 09 10:36:17.465219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 86/192] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:17 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:17.570214 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-920876ae-118d-47ef-88a5-03ad39f1cdbd req-70926f11-cc86-4f43-85cf-5cb33e673bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f4033-0246-4cb7-bc44-78fc79681448", "name": "network-vif-plugged", "status": "completed", "tag": "73f6a0f3-79c3-4d4c-ae34-908c44ee3b50"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:17.572730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:17.572730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:17.580248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-920876ae-118d-47ef-88a5-03ad39f1cdbd req-70926f11-cc86-4f43-85cf-5cb33e673bbe service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.585923 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-920876ae-118d-47ef-88a5-03ad39f1cdbd req-70926f11-cc86-4f43-85cf-5cb33e673bbe service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.592469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-920876ae-118d-47ef-88a5-03ad39f1cdbd req-70926f11-cc86-4f43-85cf-5cb33e673bbe service nova] Creating event network-vif-plugged:73f6a0f3-79c3-4d4c-ae34-908c44ee3b50 for instance 2b7f4033-0246-4cb7-bc44-78fc79681448 on hv-cinder-81662 Nov 09 10:36:17.597230 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-920876ae-118d-47ef-88a5-03ad39f1cdbd req-70926f11-cc86-4f43-85cf-5cb33e673bbe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 Nov 09 10:36:17.597849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 107/193] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:17.752109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:17.752840 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:17.759925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.760456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.767528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.767528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.916331 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:17.924373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a86c238a-1fdd-4bcc-898e-3846290d499b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.176405 Nov 09 10:36:17.925046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 87/194] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:17 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:17.983476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:17.984341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:17.990922 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.991634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:17.992446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:17.992867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.067402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:18.075339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e95cc010-660a-455b-9668-a2cd7abd9039 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1270 microversion: 2.1 time: 0.096055 Nov 09 10:36:18.075905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 108/195] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:17 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:18.417981 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:18.418787 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:18.427408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.428020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.428918 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.429508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.472530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:18.473558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:18.480043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.480490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.481304 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.481733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.567652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:18.575373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a9a5adb7-dfb0-465d-a535-17535c3297c4 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.163056 Nov 09 10:36:18.575795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 88/196] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:18 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:18.587014 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-92a679b1-b439-45f1-939f-1404dac4b7db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.118005 Nov 09 10:36:18.587631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 109/197] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:18 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:18.941800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:18.946237 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:18.948998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.949491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:18.950270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:18.950731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.094491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:19.095185 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:19.103078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.103514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.104332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.104757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.107606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:19.115417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-13d29cc9-0943-4c67-bf18-f9f1161fbbc5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.177280 Nov 09 10:36:19.125327 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 89/198] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:18 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:19.195063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:19.208911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a2d299b4-ba1f-4d8b-9d65-98999c745e18 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1278 microversion: 2.1 time: 0.118251 Nov 09 10:36:19.209673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 110/199] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:19 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:19.592562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:19.593803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:19.598642 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:19.600185 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:19.600384 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.600864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.601668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.602105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.607655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.612869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.612869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:19.612869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:19.749262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:19.761797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5519d828-06b9-4dee-9636-e6683d478e88 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.167856 Nov 09 10:36:19.767169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 90/200] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:19 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:20.132304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:20.132893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:20.139243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.139690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.140546 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.140914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.281869 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:20.289902 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b644a742-5238-4bc1-8424-4dffacf2f390 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.161320 Nov 09 10:36:20.290478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 91/201] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:20 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:20.295821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:20.296477 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:20.302588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.303027 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.320098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.320098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.367452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:20.375853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f48bf6de-e384-4f99-ba9d-8f3c912b4a3b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1278 microversion: 2.1 time: 0.083517 Nov 09 10:36:20.376469 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 92/202] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:20 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:20.775051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:20.775743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:20.782473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.782919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.783737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:20.784210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:20.948351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:20.957100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3892b178-9766-4c64-8602-404cefdf8d9a tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.186278 Nov 09 10:36:20.957869 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 93/203] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:20 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:21.306290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:21.306896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:21.312754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.313194 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:21.313955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.314556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:21.448526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:21.456474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ab028e43-32e2-4fa9-903d-1fc79e9e17e8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.153621 Nov 09 10:36:21.457185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 94/204] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:21 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:21.462265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:21.462873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:21.469077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.469519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:21.470300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.470728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:21.537697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:21.547376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-be72c978-8fce-47ea-8dd4-0c5cf1589201 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1278 microversion: 2.1 time: 0.088672 Nov 09 10:36:21.552714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 95/205] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:21 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:21.828381 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4f007626-a978-4376-b6a2-b1dd457a8bb9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 2.233462 Nov 09 10:36:21.830012 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 111/206] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:19 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:21.975107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:21.976222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:21.984307 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.984745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:21.985706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:21.986323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.199711 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:22.207799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-db3b938d-55c6-4bc9-8a36-9ca1014e3890 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.236770 Nov 09 10:36:22.208642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 96/207] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:21 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:22.475421 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:22.476913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:22.485661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.486387 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.487239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.487883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.563704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:22.564358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:22.576533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.576980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.577777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.578222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.819776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:22.829628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-92979afc-1c7b-4075-8dc0-b3e540a65a8e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.358929 Nov 09 10:36:22.833354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 112/208] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:22 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:22.848093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:22.850538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:22.865123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.866518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.872839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:22.873495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:22.881541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:22.891845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5d6dd21e-861e-41c4-b7df-05cb5dec6f09 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.332504 Nov 09 10:36:22.894616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 97/209] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:22 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:23.022038 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-686e36eb-de39-4808-96a2-5a9b17c9454e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 0.184023 Nov 09 10:36:23.023349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 113/210] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:22 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:23.227406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:23.230346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:23.237830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.238905 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.239960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.240563 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.402844 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:23.410297 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e4da0a38-020f-440a-8d13-be1bf2af2016 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1315 microversion: 2.1 time: 0.190070 Nov 09 10:36:23.410867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 98/211] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:23 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:23.787145 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-0b0f6351-34e3-433e-9f29-7e1334ce32ce req-c5bd219a-5df9-4a76-bb9d-9a3b9156a976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf9a9cd-5816-4665-bcc6-e2a754b943c0", "tag": "f137f694-12be-40a2-af9b-d28f9b1b9082"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:23.791418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:23.791418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:23.801065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-0b0f6351-34e3-433e-9f29-7e1334ce32ce req-c5bd219a-5df9-4a76-bb9d-9a3b9156a976 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.801581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-0b0f6351-34e3-433e-9f29-7e1334ce32ce req-c5bd219a-5df9-4a76-bb9d-9a3b9156a976 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.813922 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-0b0f6351-34e3-433e-9f29-7e1334ce32ce req-c5bd219a-5df9-4a76-bb9d-9a3b9156a976 service nova] Creating event network-changed:f137f694-12be-40a2-af9b-d28f9b1b9082 for instance daf9a9cd-5816-4665-bcc6-e2a754b943c0 on hv-cinder-81662 Nov 09 10:36:23.818804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-0b0f6351-34e3-433e-9f29-7e1334ce32ce req-c5bd219a-5df9-4a76-bb9d-9a3b9156a976 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037514 Nov 09 10:36:23.819618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 114/212] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:23.849595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:23.850334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:23.871801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.872269 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.873319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.873961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.909595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:23.910311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:23.917210 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.917663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:23.918447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:23.918875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.022017 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:24.036866 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-451bf858-bb79-460d-8cec-a25531413353 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.190949 Nov 09 10:36:24.037700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 99/213] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:23 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:24.042536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:24.043525 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:24.056043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.056043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.056043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.056043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.161697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:24.169311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-212e4fad-063a-46d8-bb99-921ef4c67ba7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.264097 Nov 09 10:36:24.170087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 115/214] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:23 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:24.262803 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:24.263331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:24.269913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.270355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.276076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.276076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.297833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:36:24.817862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-afeb4784-d5a6-4bf0-a42a-3067dcd7ad96 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "DELETE /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 204 len: 0 microversion: 2.1 time: 0.558673 Nov 09 10:36:24.822761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 116/215] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:36:24 2021] DELETE /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 10:36:24.824286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:24.825004 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:24.832499 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.833020 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.833687 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.834134 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.972011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:24.980156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2fc05ce8-0b78-4036-873f-07303e6c1cb5 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1465 microversion: 2.1 time: 0.160167 Nov 09 10:36:24.981269 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 117/216] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:24 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:24.985079 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:24.985682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:24.992339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.992793 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:24.993637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:24.994078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.126545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:25.134876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8ace9d7f-9587-454b-90c5-9fb827bde80d tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1554 microversion: 2.1 time: 0.153138 Nov 09 10:36:25.135457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 118/217] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:24 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:25.139843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:25.140356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:25.147005 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.147175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f2f3a69f-d552-4e24-814e-cf683b394157 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14 microversion: 2.20 time: 1.107842 Nov 09 10:36:25.147657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.148698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 100/218] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:24 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:25.148943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.149697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.153677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:25.154490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:25.161703 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.162267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.163069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.164421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.179104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:36:25.298908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:25.306219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bb9f73bb-af2e-4e86-a77c-3502ee04b8b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.156504 Nov 09 10:36:25.306787 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 101/219] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:25 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:25.310943 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:25.311536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:25.317173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.324291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.324291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.324291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.458708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:25.466667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2f632d8-0482-4b94-b2af-c136d81f507d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.158945 Nov 09 10:36:25.467260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 102/220] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:25 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:25.517646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b650f16a-fd2e-409e-83c5-abb0606728dc tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 204 len: 0 microversion: 2.1 time: 0.380889 Nov 09 10:36:25.518189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 119/221] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:36:25 2021] DELETE /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:36:25.526659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:25.527268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:25.533316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.533855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.534636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:25.535069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:25.662639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:25.669929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6473431a-f746-4428-aecd-fc4ca235ad79 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1471 microversion: 2.1 time: 0.147596 Nov 09 10:36:25.670491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 103/222] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:25 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:26.152696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:26.153557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:26.158514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:26.159482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:26.159771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.160252 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.161054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.161485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.166458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.166901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.167698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.168140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.532937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:26.540845 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a170b592-322b-488a-ad47-fb5a74670522 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1554 microversion: 2.1 time: 0.392234 Nov 09 10:36:26.541418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 120/223] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:26 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1554 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:26.545627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:26.546420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:26.553196 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.553654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.554940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.555364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.689397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:26.697459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-adb09b6e-6a45-44ac-8b7c-7f7ebbae1f36 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.155144 Nov 09 10:36:26.698033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 121/224] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:26 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:26.702409 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:26.702968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:26.708790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.709231 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.709992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.710413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.842965 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:26.851767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-632a9033-5a92-42b8-8e7b-440f2d62d31c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.152212 Nov 09 10:36:26.852382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 122/225] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:26 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:26.856884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:26.857490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:26.863755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.864405 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.865098 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:26.865532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:26.997018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:27.004837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3f76dda3-8070-4c21-9447-b3d24d8a9377 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1471 microversion: 2.1 time: 0.151432 Nov 09 10:36:27.005417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 123/226] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:26 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:27.261012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b7e899b1-49de-4121-a7cc-7eda8680c974 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 7541 microversion: 2.20 time: 1.105803 Nov 09 10:36:27.262039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 104/227] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:26 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 7541 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:36:27.558443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:27.559067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:27.566392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.566837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.567627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.568163 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.715622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:27.716340 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:27.723298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.723721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.724529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.724960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.755810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:27.765085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-651bc5ea-2ee9-494b-a20e-8c60458c8433 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1554 microversion: 2.1 time: 0.210338 Nov 09 10:36:27.765673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 124/228] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:27 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:27.863080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:27.869111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:27.869939 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:27.876058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.876501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.877303 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:27.877772 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:27.885417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-828a3d1d-544c-42e2-bb0e-e5e769c71fc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.174728 Nov 09 10:36:27.886382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 105/229] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:27 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:28.022503 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:28.023651 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:28.030849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.031482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.032460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.033035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.040704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:28.048159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2704d04d-4abe-4a33-8a1b-8206954cc4c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.183257 Nov 09 10:36:28.048722 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 125/230] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:27 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:28.162678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:28.170562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a9dcce7c-a035-4b34-9b32-3c32eb925876 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1471 microversion: 2.1 time: 0.151933 Nov 09 10:36:28.171121 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 106/231] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:28 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:28.279208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:28.281203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:28.289503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.290120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.290918 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.291354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.402532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-99f79d6c-60bf-4a1a-a187-cd9eed01d362 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 11371 microversion: 2.20 time: 0.126975 Nov 09 10:36:28.403074 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 126/232] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:28 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 11371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:28.782489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:28.783111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:28.789108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.789567 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.790321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.790753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.902728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:28.903481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:28.910345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.910790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.911566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:28.912051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:28.932810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:28.940440 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5d16eeb5-3509-4019-a67d-cc6971f3d617 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1554 microversion: 2.1 time: 0.161504 Nov 09 10:36:28.941021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 107/233] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:28 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:29.058385 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:29.065481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:29.071347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-78e2134d-4e2d-4665-bf35-c80b10e6532a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.167144 Nov 09 10:36:29.071475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:29.071562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 127/234] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:28 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:29.073049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.073499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.074604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.074604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.188635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:29.189389 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:29.195745 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.196445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.197420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.197993 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.214880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:29.222534 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b87d0a06-73c5-44a3-be85-444abc0565af tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.161465 Nov 09 10:36:29.223109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 108/235] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:29 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:29.337520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:29.344844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-fcfe74c0-1914-4bb5-be28-7053c38d2e4d tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1471 microversion: 2.1 time: 0.160830 Nov 09 10:36:29.345436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 128/236] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:29 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:29.414039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:29.415135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:29.421325 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.421775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.422607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.423050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.532599 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-66725e7a-c6c8-44ba-9be8-c9f2165b2882 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 14127 microversion: 2.20 time: 0.122482 Nov 09 10:36:29.533258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 109/237] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:29 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 14127 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:29.957279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:29.957762 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:29.969818 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.972911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:29.972911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:29.972911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.083150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:30.083845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:30.091873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.092310 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.093092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.093522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.199495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:30.209185 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-db41287a-ddfb-4eb0-ac18-e141e06b5d9a tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1554 microversion: 2.1 time: 0.255526 Nov 09 10:36:30.210166 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 129/238] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:29 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1554 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:30.244042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:30.244661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:30.254612 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:30.257307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.258518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.259359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.259785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.265121 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5b2f4335-cb99-4d48-bae1-42584f81bc01 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.184556 Nov 09 10:36:30.266683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 110/239] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:30 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:30.364792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:30.365689 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:30.372192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.373164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.374544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.375154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.490898 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:30.500739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e379e158-6d5a-4e83-a387-24fa304a2328 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.263250 Nov 09 10:36:30.501798 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 130/240] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:30 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:30.543959 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:30.545274 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:30.551533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.552204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.553148 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.553345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.646802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-28fc4fad-34bd-41eb-ade1-498399c03530 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 16319 microversion: 2.20 time: 0.106590 Nov 09 10:36:30.648490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 131/241] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:30 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 16319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:30.654934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:30.663786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5650c281-655f-4e0f-9641-b487ed04453c tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1471 microversion: 2.1 time: 0.303782 Nov 09 10:36:30.670255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 111/242] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:30 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:30.716138 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-681694da-d8e8-43f4-b62f-1fb48cf25b7a req-8a60023a-8eaf-41bb-8e50-e714b672bbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f4033-0246-4cb7-bc44-78fc79681448", "name": "network-vif-deleted", "tag": "73f6a0f3-79c3-4d4c-ae34-908c44ee3b50"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:30.717137 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:30.717137 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:30.726894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-681694da-d8e8-43f4-b62f-1fb48cf25b7a req-8a60023a-8eaf-41bb-8e50-e714b672bbb1 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:30.727385 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-681694da-d8e8-43f4-b62f-1fb48cf25b7a req-8a60023a-8eaf-41bb-8e50-e714b672bbb1 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:30.743121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-681694da-d8e8-43f4-b62f-1fb48cf25b7a req-8a60023a-8eaf-41bb-8e50-e714b672bbb1 service nova] Creating event network-vif-deleted:73f6a0f3-79c3-4d4c-ae34-908c44ee3b50 for instance 2b7f4033-0246-4cb7-bc44-78fc79681448 on hv-cinder-81662 Nov 09 10:36:30.751015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-681694da-d8e8-43f4-b62f-1fb48cf25b7a req-8a60023a-8eaf-41bb-8e50-e714b672bbb1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040784 Nov 09 10:36:30.751015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 132/243] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:31.162357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-5f260e3b-fd83-4c93-9df1-3ae7f95dafbf req-3f86c476-3dcc-4317-9180-938fbc56b1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c07487-72bd-4c21-8d60-f4bbce7fba5a", "name": "network-vif-deleted", "tag": "5b4082fe-5c36-4667-a041-200e50fb0ba6"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:31.176324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:31.176324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:36:31.196295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-5f260e3b-fd83-4c93-9df1-3ae7f95dafbf req-3f86c476-3dcc-4317-9180-938fbc56b1dd service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.197471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-5f260e3b-fd83-4c93-9df1-3ae7f95dafbf req-3f86c476-3dcc-4317-9180-938fbc56b1dd service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.217210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-5f260e3b-fd83-4c93-9df1-3ae7f95dafbf req-3f86c476-3dcc-4317-9180-938fbc56b1dd service nova] Creating event network-vif-deleted:5b4082fe-5c36-4667-a041-200e50fb0ba6 for instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a on hv-cinder-81662 Nov 09 10:36:31.225825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-5f260e3b-fd83-4c93-9df1-3ae7f95dafbf req-3f86c476-3dcc-4317-9180-938fbc56b1dd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069855 Nov 09 10:36:31.227528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 112/244] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:31.240475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:31.244296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:31.249081 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.249528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.250527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.251151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.283843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:31.284895 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:31.292020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.292859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.294189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.294860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.330616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:31.358075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0a3d5a2d-7fa7-4267-9dc7-914de7067947 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1512 microversion: 2.1 time: 0.132577 Nov 09 10:36:31.358725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 133/245] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:31 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1512 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:31.461225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:31.478196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e07527d6-a8e9-41eb-a0e9-9b0513a26238 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.198349 Nov 09 10:36:31.479152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 113/246] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:31 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:31.519366 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:31.519366 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:31.527841 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.528318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.529121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.529567 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.679525 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:31.681122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:31.690020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.690851 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.692102 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.692690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.736329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:31.744873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d91066b0-2ad3-4ed5-b089-3d7acd302774 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.230440 Nov 09 10:36:31.745623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 134/247] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:31 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:31.752243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:31.753086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:31.759438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.760193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.761004 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.761435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.794642 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:31.795088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:31.795535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lazy-loading 'fault' on Instance uuid 2b7f4033-0246-4cb7-bc44-78fc79681448 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:36:31.823771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ad7a0f62-fb19-4bdd-9efd-5856d523037d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 18305 microversion: 2.20 time: 0.159086 Nov 09 10:36:31.823771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 114/248] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:31 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 18305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:31.857154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ceca813624a78b1d1e0f602d590c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d823ea16c394a2db96710191d5f5e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:31.865513 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a244457f-5ca7-4719-b626-5666331c5e32 tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 200 len: 1305 microversion: 2.1 time: 0.118712 Nov 09 10:36:31.866101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 135/249] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:31 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:32.375465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:32.376101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:32.383588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.384065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.384849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.385285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.416536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.416977 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.417445 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lazy-loading 'fault' on Instance uuid 30c07487-72bd-4c21-8d60-f4bbce7fba5a {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:36:32.467147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e5a722dfa64974b62e590a559a0e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc589f1addda41c09c4c042f7af97752', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:32.476131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ec0b558a-6fe0-483e-9a3e-d315b35bb139 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 200 len: 1351 microversion: 2.1 time: 0.104381 Nov 09 10:36:32.477100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 115/250] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:32 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:32.498713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:32.499418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:32.510060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.510507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.511288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.511722 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.663360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:32.670711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8bc551a9-442c-4dbd-b1f1-d84bc804fea4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.175908 Nov 09 10:36:32.671285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 136/251] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:32 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:32.766699 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:32.767319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:32.775888 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.776363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.777147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.777748 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.833964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:32.837080 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:32.848265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.848731 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.849526 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.849976 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.961816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:32.970837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-da758a99-10e8-48b7-9e44-3bda9e83a51b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.207648 Nov 09 10:36:32.972278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 116/252] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:32 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:32.977148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:32.980957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] [instance: 2b7f4033-0246-4cb7-bc44-78fc79681448] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:32.989598 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.990339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.991392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:32.991836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:32.994956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a8851866-acea-4cc5-be19-da41d4baa444 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 18449 microversion: 2.20 time: 0.163996 Nov 09 10:36:32.995602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 137/253] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:32 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 18449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:33.007863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] HTTP exception thrown: Instance 2b7f4033-0246-4cb7-bc44-78fc79681448 could not be found. Nov 09 10:36:33.008072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] Returning 404 to user: Instance 2b7f4033-0246-4cb7-bc44-78fc79681448 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:33.009096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9ad0b41e-4fd8-488b-93c8-c7f238dd555b tempest-VolumesNegativeTest-1040988805 tempest-VolumesNegativeTest-1040988805-project] 10.222.0.35 "GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448" status: 404 len: 111 microversion: 2.1 time: 0.035679 Nov 09 10:36:33.009797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 117/254] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:32 2021] GET /compute/v2.1/servers/2b7f4033-0246-4cb7-bc44-78fc79681448 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:36:33.495860 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:33.496596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:33.508489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.509282 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.513764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.513764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.539624 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-28ee228f-6e26-4b83-8237-e036e672d0f7 req-258e03c5-f1b2-42c1-b396-e4ef2faf08ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf9a9cd-5816-4665-bcc6-e2a754b943c0", "name": "network-vif-plugged", "status": "completed", "tag": "f137f694-12be-40a2-af9b-d28f9b1b9082"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:33.541646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:33.541646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:36:33.545208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] HTTP exception thrown: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. Nov 09 10:36:33.545933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Returning 404 to user: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:33.547055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-720c3dcc-02d9-49e1-a081-892629423cc3 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 404 len: 111 microversion: 2.1 time: 0.057146 Nov 09 10:36:33.550698 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 138/255] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:33 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:36:33.557636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-28ee228f-6e26-4b83-8237-e036e672d0f7 req-258e03c5-f1b2-42c1-b396-e4ef2faf08ba service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.557636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-28ee228f-6e26-4b83-8237-e036e672d0f7 req-258e03c5-f1b2-42c1-b396-e4ef2faf08ba service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.580786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-28ee228f-6e26-4b83-8237-e036e672d0f7 req-258e03c5-f1b2-42c1-b396-e4ef2faf08ba service nova] Creating event network-vif-plugged:f137f694-12be-40a2-af9b-d28f9b1b9082 for instance daf9a9cd-5816-4665-bcc6-e2a754b943c0 on hv-cinder-81662 Nov 09 10:36:33.591322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-28ee228f-6e26-4b83-8237-e036e672d0f7 req-258e03c5-f1b2-42c1-b396-e4ef2faf08ba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057047 Nov 09 10:36:33.592632 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 118/256] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:36:33.690163 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:33.697628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:33.709275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:33.710697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:33.717840 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.718372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.719296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.719838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.722736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.723584 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.724980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.726243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.742841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] HTTP exception thrown: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. Nov 09 10:36:33.743553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Returning 404 to user: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:33.745328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6902d422-4a4a-4765-8c82-21058465043c tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041247 Nov 09 10:36:33.746006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 119/257] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:36:33 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:36:33.945702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:33.955653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e7abbe16-5d1a-4d6e-972d-ac4dfbbd758c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.271928 Nov 09 10:36:33.959655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 139/258] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:33 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:33.987777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:33.989227 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:33.998021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:33.998856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:33.999653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:34.002399 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:34.010940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:34.012773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:34.019687 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:34.020192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:34.020997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:34.022112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:34.146292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c60121be-920f-46b4-8f71-6f11cdb42e76 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 19774 microversion: 2.20 time: 0.141607 Nov 09 10:36:34.146938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 140/259] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:34 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 19774 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:34.203368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:34.213563 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f4cafc7e-2af6-4e81-a398-72d77353656d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.229406 Nov 09 10:36:34.226995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 120/260] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:33 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:34.974930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:34.975693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:34.983243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:34.983892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:34.984913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:34.985605 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.135998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:35.143693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-762abf1a-7ae0-4a37-bd11-420fe98ace82 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.173253 Nov 09 10:36:35.144327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 141/261] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:34 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:35.159242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:35.160822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:35.171672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.172161 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.172956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.173392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.237488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:35.242767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:35.248190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.248598 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.249394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.249920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.273086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8c2fe73a-afb8-4eca-9877-e9bff3cd9aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 21726 microversion: 2.20 time: 0.118520 Nov 09 10:36:35.274080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 121/262] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:35 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 21726 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:35.282948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:35.283701 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:35.295206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.296159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.297344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.298100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.323362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] HTTP exception thrown: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. Nov 09 10:36:35.324652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Returning 404 to user: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:35.326957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-46fdaf61-b087-466a-8868-5e69f18c0a0e tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "DELETE /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 404 len: 111 microversion: 2.1 time: 0.050530 Nov 09 10:36:35.327922 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 122/263] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:36:35 2021] DELETE /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:36:35.340997 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:35.342256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] [instance: 30c07487-72bd-4c21-8d60-f4bbce7fba5a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:35.353070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.354133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.355452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:35.356195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:35.389893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] HTTP exception thrown: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. Nov 09 10:36:35.390882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] Returning 404 to user: Instance 30c07487-72bd-4c21-8d60-f4bbce7fba5a could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:35.392203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3fa7611c-2e10-462e-9982-9f6d30b1d9f7 tempest-DeleteServersTestJSON-1848161486 tempest-DeleteServersTestJSON-1848161486-project] 10.222.0.35 "GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a" status: 404 len: 111 microversion: 2.1 time: 0.057683 Nov 09 10:36:35.398094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 123/264] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:35 2021] GET /compute/v2.1/servers/30c07487-72bd-4c21-8d60-f4bbce7fba5a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:36:35.434238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:35.442646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6df9951d-bec2-4e34-946f-342686e75b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1318 microversion: 2.1 time: 0.216460 Nov 09 10:36:35.444023 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 142/265] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:35 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:36.160394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:36.160971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:36.177112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.177471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.178270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.179729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.286585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:36.301107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:36.301107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.301107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.301107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.301856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.409461 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-abcc87fa-9ef5-46b8-af22-563439d0a88f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 22965 microversion: 2.20 time: 0.126679 Nov 09 10:36:36.410440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 143/266] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:36 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 22965 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:36.472214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:36.475391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:36.476582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:36.480203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-68c76d80-44c4-4569-bb58-14c1930f6666 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.323386 Nov 09 10:36:36.492412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 124/267] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:36 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:36.508305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.508796 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.512661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.514498 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.844636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:36.852627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d839dd98-1201-4537-9a37-523caac186da tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1509 microversion: 2.1 time: 0.396332 Nov 09 10:36:36.853516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 144/268] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:36 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:36.875333 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73eaf7fe-d953-4b3e-8d88-8b2369d02d6a"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:36.876588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:36.884063 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.884508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:36.885337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:36.885774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.003901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Invalid volume: volume 73eaf7fe-d953-4b3e-8d88-8b2369d02d6a is already attached to instances: 4625928f-8448-4d86-b1e6-28b6c5ddac57 Nov 09 10:36:37.004782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 400 to user: Invalid volume: volume 73eaf7fe-d953-4b3e-8d88-8b2369d02d6a is already attached to instances: 4625928f-8448-4d86-b1e6-28b6c5ddac57 {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:36:37.005836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-02e12684-4ad6-431c-bc4e-25290e47fdbb tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135726 Nov 09 10:36:37.006754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 125/269] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:36:36 2021] POST /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:36:37.167427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:37.167935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:37.174344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.174811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.175591 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.176074 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.424031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:37.427538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:37.437022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.438052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.438918 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.439351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.520558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'services' on Instance uuid 4625928f-8448-4d86-b1e6-28b6c5ddac57 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:36:37.533859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9f87c6a5-4086-49a2-b4f1-6bde6da4b60b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 24098 microversion: 2.20 time: 0.113996 Nov 09 10:36:37.534702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 126/270] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:37 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 24098 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:37.540859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:37.542061 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:37.563722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.563722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.563722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:37.564096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:37.993047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:37.993047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ebf25d82-f42d-4c1b-a6f6-4bb3da58fa16 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.283506 Nov 09 10:36:37.993047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 127/271] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:37 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:38.508380 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7074d185-8855-4efb-9f88-21f9f677ea72 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments/73eaf7fe-d953-4b3e-8d88-8b2369d02d6a" status: 202 len: 0 microversion: 2.1 time: 1.343284 Nov 09 10:36:38.509501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 145/272] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:36:37 2021] DELETE /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments/73eaf7fe-d953-4b3e-8d88-8b2369d02d6a => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:38.518125 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:38.519045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:38.527646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.528666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:38.529824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.530430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:38.564961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:38.564961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:38.564961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.564961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:38.565777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.565777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:38.584689 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-37225def-b9c5-46ad-ab51-3f14fb1812f6 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070438 Nov 09 10:36:38.585821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 128/273] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:36:38 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:38.643213 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b1865262-589e-4116-b5ff-13dec5b1ccdc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 24955 microversion: 2.20 time: 0.100881 Nov 09 10:36:38.657838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 146/274] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:38 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 24955 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:38.941566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:38.942399 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:38.956361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.957550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:38.959094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:38.960829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:39.130849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:39.140903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-53ab1676-be9a-4b4c-934a-49201efbb2d6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.203616 Nov 09 10:36:39.141545 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 129/275] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:38 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:39.603096 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:39.604829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:39.612575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:39.613352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:39.614616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:39.615234 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:39.650578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-33e89302-2e6c-4d0b-aa40-755de4bbb775 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057538 Nov 09 10:36:39.654674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 147/276] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:36:39 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:39.658539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:39.659748 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:39.667286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:39.667736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:39.668577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:39.669019 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:39.778771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-997b59af-1a58-4e1b-b2c9-71677cb15dac tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 25551 microversion: 2.20 time: 0.125472 Nov 09 10:36:39.779855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 130/277] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:39 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 25551 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:40.160193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:40.161232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:40.171729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.171729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.171729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.172514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.309514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-187367947", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "f51c9ba3-bc65-47a2-b101-28e93246c8bd"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:40.380045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:40.384489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] validate_networks() for [('f51c9ba3-bc65-47a2-b101-28e93246c8bd', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:36:40.396621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-77fdb693-e321-41dc-a5e1-91d6e0f4fb6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.236644 Nov 09 10:36:40.396621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 148/278] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:40 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:40.669730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:40.673788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:40.697507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.698763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.699763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.704611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.750615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-03a1a034-0a21-48c0-a1de-583e0fdfe374 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092269 Nov 09 10:36:40.753319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 149/279] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:36:40 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:36:40.791422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:40.792631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:40.802209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.802666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.803457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.804534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.808622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:36:40.809655 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:36:40.812491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:36:40.813126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:36:40.813834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:36:40.833958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.842602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.844432 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:40.845658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:40.877552 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Getting quotas for project bcca51d6c84d4962857babeca9f19d26. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:36:40.895995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Getting quotas for user e45f2b7be7df4f8e91aa9b6b9b6ecf72 and project bcca51d6c84d4962857babeca9f19d26. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:36:40.910219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:36:40.912769 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:36:40.939019 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b2028d73-cfc2-49b2-aa3b-e269c67da0d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 26306 microversion: 2.20 time: 0.151397 Nov 09 10:36:40.939931 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 150/280] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:40 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 26306 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:41.027568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-530477485", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "5554d1a8-4766-4ee1-bd4f-871198ca55f6"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:41.045832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-27ab6b31-6913-4b1c-b1fc-e7691a2df6e4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736501 Nov 09 10:36:41.047362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 131/281] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:36:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 10:36:41.057481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-87bc263e-f991-4030-ace3-573070d8f578 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:41.059621 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-87bc263e-f991-4030-ace3-573070d8f578 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:41.123984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] validate_networks() for [('5554d1a8-4766-4ee1-bd4f-871198ca55f6', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:36:41.157413 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-87bc263e-f991-4030-ace3-573070d8f578 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:41.167289 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-87bc263e-f991-4030-ace3-573070d8f578 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1213 microversion: 2.1 time: 0.114011 Nov 09 10:36:41.167870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 132/282] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:41 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:41.416011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:41.416726 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:41.433467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.434449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:41.435330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.435984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:41.633273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:36:41.633835 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:36:41.634988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:36:41.634988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:36:41.635465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:36:41.637667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:41.647404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c534d35b-65b7-474d-a5ee-f3c45b90ec89 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.236688 Nov 09 10:36:41.648501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 133/283] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:41 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:41.650069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.650763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:41.652031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.652862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:41.671788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:36:41.676506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for user 1a255547966e430bac7a2b4d0c0727b1 and project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:36:41.695504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:36:41.698296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:36:41.893850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-944a816a-bdbd-47f4-a3ea-7c118b92d8ef tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870095 Nov 09 10:36:41.895206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 151/284] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:36:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:36:41.921817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e828294c-e4fd-4a6a-828b-e92246c0c4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:41.922514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e828294c-e4fd-4a6a-828b-e92246c0c4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:41.953647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:41.954961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:41.970892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.976396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:41.976396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:41.976396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:42.007727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e828294c-e4fd-4a6a-828b-e92246c0c4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:42.016937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e828294c-e4fd-4a6a-828b-e92246c0c4e7 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1217 microversion: 2.1 time: 0.101062 Nov 09 10:36:42.024155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 134/285] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:41 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:42.076417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ae6dbf9f-9d20-4c39-8b25-7da79ba3aebc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 26930 microversion: 2.20 time: 0.126402 Nov 09 10:36:42.077411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 152/286] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:41 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 26930 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:42.185459 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4f318370-7286-408e-8548-747ea2006b49 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:42.186177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4f318370-7286-408e-8548-747ea2006b49 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:42.249366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4f318370-7286-408e-8548-747ea2006b49 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:42.258413 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4f318370-7286-408e-8548-747ea2006b49 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1213 microversion: 2.1 time: 0.076607 Nov 09 10:36:42.259069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 135/287] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:42 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:42.666895 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:42.667585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:42.674633 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:42.675762 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:42.677086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:42.677843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:42.898358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:42.904249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4f495cd9-5633-4e45-88be-ed05e2e1ccef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.241262 Nov 09 10:36:42.913874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 153/288] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:42 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:43.042342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-af1f62d1-aae5-4146-8dcb-b1d6b6641ca8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:43.042966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-af1f62d1-aae5-4146-8dcb-b1d6b6641ca8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:43.093527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:43.097099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:43.106538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.109423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:43.112882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.113438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:43.122037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-af1f62d1-aae5-4146-8dcb-b1d6b6641ca8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:43.127112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-af1f62d1-aae5-4146-8dcb-b1d6b6641ca8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1217 microversion: 2.1 time: 0.088123 Nov 09 10:36:43.128131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 136/289] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:43 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:43.237137 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b26096d1-8a2e-4ac2-8a1e-88313f26aa28 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 27358 microversion: 2.20 time: 0.151348 Nov 09 10:36:43.238232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 154/290] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:43 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 27358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:36:43.274358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:43.275202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:43.296099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.296541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:43.297385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.297940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:43.377329 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:43.389092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d3c6c5b2-1f72-4d21-83fc-74d32cd257d0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1209 microversion: 2.1 time: 0.118236 Nov 09 10:36:43.389677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 137/291] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:43 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:43.921690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:43.922405 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:43.943547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.944178 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:43.945098 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:43.945609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.140241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:44.148499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:44.157173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-288ae23e-78e0-42f6-84aa-e7ed5aa98074 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.238932 Nov 09 10:36:44.169611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 155/292] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:43 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:44.169897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:44.178014 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.178794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.179842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.180318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.252284 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:44.253268 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:44.254112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:44.262044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4d0c8ab3-a063-446a-b839-4d3a6fb8c71a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1213 microversion: 2.1 time: 0.119621 Nov 09 10:36:44.262408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.262618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 138/293] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:44 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:44.262903 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.263697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.264176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.406649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:44.407267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:44.413491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.413936 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.414771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:44.415206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:44.474817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:44.482610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3c928e6f-438d-4f97-adf6-9c39e139ef80 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1273 microversion: 2.1 time: 0.079667 Nov 09 10:36:44.483185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 139/294] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:44 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:44.592568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-28c1bee6-f5f7-492d-b958-f4e265c1c935 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 27585 microversion: 2.20 time: 0.344026 Nov 09 10:36:44.594129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 156/295] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:44 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 27585 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:45.178853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:45.180063 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:45.186934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.187376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.188370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.188991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.281200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:45.281670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:45.296345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.296345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.296345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.296345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.380795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:45.391159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-732d5947-f0e9-44f1-a3c0-821c4ef74684 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1269 microversion: 2.1 time: 0.115501 Nov 09 10:36:45.400850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 157/296] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:45 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:45.465351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:45.475273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2c0ed956-27e7-4735-a6d6-6af48f078805 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1522 microversion: 2.1 time: 0.302689 Nov 09 10:36:45.476567 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 140/297] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:45 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:45.502160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:45.502862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:45.511778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.512406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.513413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.513908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.610855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:45.612468 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:45.614708 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:45.619259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.619842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.620757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:45.621309 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:45.622769 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-036b1281-9a9b-43e7-93a0-5305db7b5776 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1271 microversion: 2.1 time: 0.125598 Nov 09 10:36:45.641053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 158/298] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:45 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:45.764983 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4c072426-51fa-4e15-a78b-f6ef87bbf886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 27750 microversion: 2.20 time: 0.158469 Nov 09 10:36:45.769491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 141/299] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:45 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 27750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:46.408344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:46.409036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:46.416750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.417470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.418468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.419296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.480940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:46.490129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d7c7c838-121d-4b65-856f-b3c008bd0664 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1275 microversion: 2.1 time: 0.085647 Nov 09 10:36:46.490703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 159/300] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:46 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:46.493514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:46.494295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:46.502283 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.502805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.505619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.507411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.662486 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:46.663578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:46.683770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.684305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.685141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.685627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.869252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:46.873987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9da90ff3-2431-4001-b304-2d77d9ae245a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1502 microversion: 2.1 time: 0.384591 Nov 09 10:36:46.885561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 142/301] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:46 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:46.890937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:46.892220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:46.900602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.901052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.901852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.902279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.938476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:46.946945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-efb9e55a-8fde-4baf-84c0-44236cc01c3a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.288208 Nov 09 10:36:46.951135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 160/302] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:46 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:46.952011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:46.952621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:46.958403 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.959086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.959848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:46.960362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:46.987042 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-474f306c-dc3a-43d7-a0a7-439654c26f38 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28129 microversion: 2.20 time: 0.099855 Nov 09 10:36:46.992677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 143/303] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:46 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28129 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:47.103729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-7a4797cd-f10b-4330-bb06-d07d4a9530ae req-6b362507-e865-43bd-a6f5-74dcc872513e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab95f416-7cfe-4634-af31-fed4de3399a3", "tag": "448ceaab-a38a-4f15-a277-29bcf2d0c2c5"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:47.105986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:47.105986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:36:47.130393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-7a4797cd-f10b-4330-bb06-d07d4a9530ae req-6b362507-e865-43bd-a6f5-74dcc872513e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:47.132052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-7a4797cd-f10b-4330-bb06-d07d4a9530ae req-6b362507-e865-43bd-a6f5-74dcc872513e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:47.152367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-7a4797cd-f10b-4330-bb06-d07d4a9530ae req-6b362507-e865-43bd-a6f5-74dcc872513e service nova] Creating event network-changed:448ceaab-a38a-4f15-a277-29bcf2d0c2c5 for instance ab95f416-7cfe-4634-af31-fed4de3399a3 on hv-cinder-81662 Nov 09 10:36:47.159196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-7a4797cd-f10b-4330-bb06-d07d4a9530ae req-6b362507-e865-43bd-a6f5-74dcc872513e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060126 Nov 09 10:36:47.160367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 144/304] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:36:47.184311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:47.192459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9ea2c149-0faf-4d2a-9afc-ed699792c0f4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1517 microversion: 2.1 time: 0.243833 Nov 09 10:36:47.193036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 161/305] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:46 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:47.513700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:47.514611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:47.522239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:47.524406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:47.525616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:47.526305 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:47.965429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:47.966131 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:47.992015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:47.992547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:47.994059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:47.994059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:48.189687 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:48.204903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0eec6934-5b5f-4d1a-afd3-fce162e826a8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.695362 Nov 09 10:36:48.208198 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 145/306] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:47 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:48.226241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:48.226241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:48.235471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:48.236216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:48.237390 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:48.238499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:48.255138 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:48.272582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-61e62774-8cff-43d4-a529-7d1607eea4c1 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.311072 Nov 09 10:36:48.273849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 162/307] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:47 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:48.335475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a861e5c9-cd9b-4558-8786-db3314e0b515 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28129 microversion: 2.20 time: 0.121892 Nov 09 10:36:48.336088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 146/308] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:48 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28129 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:49.025480 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-9d644b7f-1326-4dbc-9713-34ab32c33c7f req-9c7d6f97-db81-4bd2-bfc2-6d72892f0b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "948f9420-0823-4643-bc32-21636281fc3a", "tag": "a85ee1a5-296a-420d-a011-888db7794ba2"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:49.027556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:49.027556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:36:49.035807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9d644b7f-1326-4dbc-9713-34ab32c33c7f req-9c7d6f97-db81-4bd2-bfc2-6d72892f0b30 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.036847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9d644b7f-1326-4dbc-9713-34ab32c33c7f req-9c7d6f97-db81-4bd2-bfc2-6d72892f0b30 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.048693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-9d644b7f-1326-4dbc-9713-34ab32c33c7f req-9c7d6f97-db81-4bd2-bfc2-6d72892f0b30 service nova] Creating event network-changed:a85ee1a5-296a-420d-a011-888db7794ba2 for instance 948f9420-0823-4643-bc32-21636281fc3a on hv-cinder-81662 Nov 09 10:36:49.053781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-9d644b7f-1326-4dbc-9713-34ab32c33c7f req-9c7d6f97-db81-4bd2-bfc2-6d72892f0b30 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033901 Nov 09 10:36:49.054503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 163/309] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:49.224715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:49.225302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:49.232907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.233356 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.234127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.234560 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.291725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:49.292927 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:49.305445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.306468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.308215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.316082 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.441186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:49.462179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4d7a8d62-9e81-4ea4-9609-076c70898e30 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.237371 Nov 09 10:36:49.462579 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 147/310] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:49 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:49.469021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:49.470094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:49.482713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.482713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.483861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.484346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.524490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:49.534051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-df07ece6-3e3c-40c1-99a8-3fcc36ad4c67 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.247677 Nov 09 10:36:49.534789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 164/311] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:49 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:49.589859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8d56fb56-56ce-4763-af53-a562962e67ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28420 microversion: 2.20 time: 0.125779 Nov 09 10:36:49.590508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 148/312] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:49 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28420 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:49.861731 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:49.862717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:49.869866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.870314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.871512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:49.872162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:49.900262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'flavor' on Instance uuid 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:36:50.230688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b858374e-920d-4fc5-9e3f-bf3953ee9e9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action" status: 200 len: 32 microversion: 2.1 time: 0.367424 Nov 09 10:36:50.230688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 165/313] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:36:49 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:36:50.237005 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:50.238325 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:50.245410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.245857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.246713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.247330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.444888 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:50.455290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-78de5ae0-931c-4c4d-8ef3-bf55386c8674 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.223167 Nov 09 10:36:50.470758 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 149/314] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:50 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:50.487536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:50.496279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:50.498176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.498784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.500099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.500703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.552795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:50.555767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:50.562775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.563484 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.564435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.565037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.722003 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:50.731442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-24767c2c-bad3-46ef-8e8a-de2a6f902bde tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.252263 Nov 09 10:36:50.742086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 166/315] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:50 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:50.748176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:50.749492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:50.756029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.756870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.758211 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:50.758361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:50.777068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:50.788857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2e886039-3d03-4428-be52-855f2e2a9d6e tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.239439 Nov 09 10:36:50.789325 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 150/316] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:50 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:50.796319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1935187269", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "660cd402-50db-4db3-8bfe-9b76071b69c8"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:50.858897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] validate_networks() for [('660cd402-50db-4db3-8bfe-9b76071b69c8', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:36:51.516867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:36:51.517626 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:36:51.518482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:36:51.519343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:36:51.519992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:36:51.536204 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:51.537115 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:51.538821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:51.539884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:51.573459 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Getting quotas for project 640b54f9b67c485a84c3d04294d65400. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:36:51.580589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Getting quotas for user 018de1115494407b913906aa29ec3316 and project 640b54f9b67c485a84c3d04294d65400. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:36:51.595636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:36:51.598250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:36:51.747898 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e77bdd15-dbdd-44fc-bc2f-7a22a28824aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957029 Nov 09 10:36:51.748953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 151/317] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:36:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:36:51.755520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:51.755520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:51.763496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:51.764153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:51.765245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:51.765932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:51.956685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:51.963537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b7f37ce9-b5dd-4778-83d5-bc9b5a24590f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.213212 Nov 09 10:36:51.964174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 152/318] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:51 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:51.979460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:51.980334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:51.990991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.001597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:52.001597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.001597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:52.153282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:52.160814 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-43a0dd6c-ae09-4eeb-9704-d15522a030d8 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.186169 Nov 09 10:36:52.161642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 153/319] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:51 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:52.166553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2632110e-bc3c-48f6-b729-0056158e1a56 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:52.167165 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2632110e-bc3c-48f6-b729-0056158e1a56 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:52.221187 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2632110e-bc3c-48f6-b729-0056158e1a56 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:52.228991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2632110e-bc3c-48f6-b729-0056158e1a56 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1219 microversion: 2.1 time: 0.066249 Nov 09 10:36:52.236454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 154/320] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:52 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:52.236454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:52.236454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:52.241362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.241805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:52.242591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.243022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:52.399394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:52.408208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c2e625e2-acda-41f6-bd50-5593763ad0c0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.177535 Nov 09 10:36:52.408789 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 155/321] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:52 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:52.981107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:52.982613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:52.989614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.990397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:52.991813 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:52.992352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.141712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:53.149809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-776001f1-5284-4dd4-9886-7e2356bb3fe5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.173059 Nov 09 10:36:53.150788 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 156/322] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:52 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:53.183267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:53.186210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:53.190719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.190719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.191441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.191913 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.348777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:53.357814 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6041c462-e1e4-4c43-824b-2482b72f2c7a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.178772 Nov 09 10:36:53.358392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 157/323] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:53 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:53.362901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:53.363513 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:53.371313 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.371774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.372834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.373260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.434045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:53.450892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-377b04f9-f8a1-404f-bbcf-feb2b6825887 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1223 microversion: 2.1 time: 0.081718 Nov 09 10:36:53.450892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 158/324] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:53 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:53.450892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:53.450892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:53.452713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.453154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.453924 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:53.454351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:53.519291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3b75208a-95f8-45a1-8873-cec54df0c36f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28420 microversion: 2.20 time: 2.775553 Nov 09 10:36:53.521560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 167/325] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:50 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28420 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:53.625928 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:53.634154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a5e6c7c7-cc00-40f0-8e45-81a0417abe6c tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.191308 Nov 09 10:36:53.634735 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 159/326] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:53 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:54.174984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:54.175710 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:54.182803 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.183275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.184090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.184516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.336936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:54.344399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e01a71ee-b9d7-414e-ab4e-1cc6aa4691a7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.173418 Nov 09 10:36:54.344967 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 168/327] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:54 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:54.375393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:54.376046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:54.382914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.383359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.384175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.384630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.458115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:54.458732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:54.465362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.465674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.466466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.467224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.523871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:54.532774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b26aed62-14e8-4031-8627-b0166ed75e21 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.161455 Nov 09 10:36:54.533551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 160/328] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:54 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:54.538128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:54.539287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:54.540223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:54.547740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.548517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.548666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0a916369-2549-4bec-b073-76ffa2fcbce2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1271 microversion: 2.1 time: 0.093799 Nov 09 10:36:54.549316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.549747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.552352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 169/329] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:54 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:54.651083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:54.651660 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:54.657882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.658323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.659677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:54.659883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:54.668833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fd8f95d6-5d37-42d6-836b-4ed8c128cf2f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.133986 Nov 09 10:36:54.669533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 161/330] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:54 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:54.820440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:54.828393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b3cbaa0a-2c1c-4e41-9c13-aedd84cb8a89 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.181286 Nov 09 10:36:54.829187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 170/331] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:54 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:55.365133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:55.365133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:55.377043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.378188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.389549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.389549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.535312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:55.542749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-eb33dcc5-0bb1-4fa5-a971-1d51ecfe5580 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.184866 Nov 09 10:36:55.545361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 162/332] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:55 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:55.557411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:55.558208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:55.564875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.565156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.565963 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.566393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.567628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:55.568685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:55.578070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.578833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.580193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.581028 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.648301 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:55.656248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-808265ec-a19a-4265-8aea-6bd8bfa18157 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1277 microversion: 2.1 time: 0.093692 Nov 09 10:36:55.656824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 163/333] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:55 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:55.683256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:55.684453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:55.692110 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.692668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.693483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.694021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.763729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:55.771164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7c089fda-359a-4aab-a18a-4987458008e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.225141 Nov 09 10:36:55.777765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-caa249fa-1d94-4c44-9768-7293a012fb3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.099965 Nov 09 10:36:55.780757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 164/334] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:55 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:55.784153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 171/335] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:55 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:55.788076 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-cfa6bfe7-f312-4027-814a-25d6fc48178b req-013ca647-017f-4928-bdd8-546c512f8467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab95f416-7cfe-4634-af31-fed4de3399a3", "name": "network-vif-plugged", "status": "completed", "tag": "448ceaab-a38a-4f15-a277-29bcf2d0c2c5"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:55.789594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:55.789594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:36:55.797483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-cfa6bfe7-f312-4027-814a-25d6fc48178b req-013ca647-017f-4928-bdd8-546c512f8467 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.797915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-cfa6bfe7-f312-4027-814a-25d6fc48178b req-013ca647-017f-4928-bdd8-546c512f8467 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.809398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-cfa6bfe7-f312-4027-814a-25d6fc48178b req-013ca647-017f-4928-bdd8-546c512f8467 service nova] Creating event network-vif-plugged:448ceaab-a38a-4f15-a277-29bcf2d0c2c5 for instance ab95f416-7cfe-4634-af31-fed4de3399a3 on hv-cinder-81662 Nov 09 10:36:55.814538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-cfa6bfe7-f312-4027-814a-25d6fc48178b req-013ca647-017f-4928-bdd8-546c512f8467 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Nov 09 10:36:55.815243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 165/336] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:36:55.845973 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:55.846585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:55.853640 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.854236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:55.855197 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:55.855955 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.004809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:56.013706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-13dc1550-b413-4c0a-ae13-468cef24de6d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.171566 Nov 09 10:36:56.014590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 172/337] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:55 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:56.561826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:56.562527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:56.569193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.569652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.570404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.570829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.687459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:56.689436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:56.698744 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.699613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.700558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.701225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.718725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:56.727871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b1bc4918-2d0f-4146-9b79-9121f19ad947 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.170164 Nov 09 10:36:56.729031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 166/338] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:56 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:56.790385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:56.791538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:56.797609 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.798052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.799005 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.799443 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.932820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:56.937669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:56.941395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c7565988-9987-4e7d-8821-971a83b68a03 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.270307 Nov 09 10:36:56.946225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c7b5d60c-f46e-4345-bd3d-ddf4a58b4ca9 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.161863 Nov 09 10:36:56.946932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 167/339] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:56 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:56.951320 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 173/340] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:56 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:56.951910 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:56.953545 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:56.959088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.960072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:56.961046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:56.961477 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.030364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:57.030967 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:57.037070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.037514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.037831 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-81d5426a-d61f-4c1f-8e99-8a352f845d5d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.089289 Nov 09 10:36:57.038364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.038795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.039078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 168/341] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:56 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:57.124585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e63496c6-e9d0-4298-854a-29d91aee7a86 req-f9f0bf91-ffa6-4876-a565-77bee5c0710d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5924110-d06d-417d-9686-b288506a4155", "tag": "57025d56-126d-4a16-a8f5-a8c2b1c1acc8"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:57.126574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:36:57.126574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:36:57.135494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e63496c6-e9d0-4298-854a-29d91aee7a86 req-f9f0bf91-ffa6-4876-a565-77bee5c0710d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.136040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e63496c6-e9d0-4298-854a-29d91aee7a86 req-f9f0bf91-ffa6-4876-a565-77bee5c0710d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.152977 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e63496c6-e9d0-4298-854a-29d91aee7a86 req-f9f0bf91-ffa6-4876-a565-77bee5c0710d service nova] Creating event network-changed:57025d56-126d-4a16-a8f5-a8c2b1c1acc8 for instance a5924110-d06d-417d-9686-b288506a4155 on hv-cinder-81662 Nov 09 10:36:57.159649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e63496c6-e9d0-4298-854a-29d91aee7a86 req-f9f0bf91-ffa6-4876-a565-77bee5c0710d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039378 Nov 09 10:36:57.161186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 169/342] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:36:57.254376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:57.264924 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7b749e92-e019-481b-8f56-d71cf9f1a692 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1313 microversion: 2.1 time: 0.238163 Nov 09 10:36:57.265682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 174/343] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:57 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:57.796482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:57.797170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:57.803339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.804502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.805378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.805816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.970972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:57.973511 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:57.985249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.986451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.988508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:57.989516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:57.990284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:58.012521 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-963fac29-b87f-4287-967c-7a35abff0370 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.220726 Nov 09 10:36:58.012945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 170/344] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:57 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:58.024285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:58.024909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:58.043539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.043539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.045260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.051055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.219756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:58.229286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c763cd22-0668-4f57-9688-8523febd6da5 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.268164 Nov 09 10:36:58.229866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 175/345] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:57 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:58.236238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:58.237423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:58.254157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:58.259911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.262904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.262904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.262904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.264521 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9c2987ac-d84b-45ad-94b2-3c1d7bef8b83 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.247599 Nov 09 10:36:58.265108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 171/346] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:58 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:58.282579 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:58.283201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:58.290542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.290987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.291788 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:58.292373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:58.345599 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8a15e2d5-6d85-4c2e-a6c1-64773a91d188 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.113521 Nov 09 10:36:58.346586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 176/347] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:58 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:58.515597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:58.524115 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aba4af3d-8135-49e1-b424-f5af9f7b2eab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1496 microversion: 2.1 time: 0.245221 Nov 09 10:36:58.524702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 172/348] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:58 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1496 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:36:59.039535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:59.040384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:59.047497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.047945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.048772 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.049207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.254169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:59.255642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:59.264865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.266090 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.267234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.267853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.419256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:59.426919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ae0fb2dd-9e6e-49d6-9fbb-89d43ea213bb tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.179306 Nov 09 10:36:59.427592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 173/349] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:59 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:59.432741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:59.433605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:59.439638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.441757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.441757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.441757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.481784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:59.489519 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3dc0a0e7-53d1-4135-8203-1f02a0f86af2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.454417 Nov 09 10:36:59.490088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 177/350] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:59 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:59.495192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:36:59.496294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:59.504988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.505435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.506281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.506650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.579876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:36:59.587883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-688fbe04-c269-4d73-8571-e873d981277a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.159266 Nov 09 10:36:59.588485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 174/351] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:36:59 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:36:59.591135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9277f430-37d1-486c-bd68-d4f129096ff8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.099086 Nov 09 10:36:59.591135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 178/352] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:36:59 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:36:59.787529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:36:59.788991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:36:59.797127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.797566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.798361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:36:59.798790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:36:59.826092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:37:00.237492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-39275323-32a3-4810-9e5d-eeb1bdcffaa5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "DELETE /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 204 len: 0 microversion: 2.1 time: 0.455603 Nov 09 10:37:00.238085 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 175/353] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:36:59 2021] DELETE /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:37:00.247330 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:00.248466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:00.255329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.255772 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.256575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.257665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.388748 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:00.396539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c48795d7-9ba2-4cb0-97d8-452672d06916 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1502 microversion: 2.1 time: 0.153485 Nov 09 10:37:00.397117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 179/354] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:00 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:00.445586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:00.446312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:00.452641 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.453090 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.453870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.454290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.506670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:00.507905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:00.514013 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.514459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.515238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.515670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.589753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:00.599864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-81faf9ec-3315-4d50-89cb-17258fe599d6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.158441 Nov 09 10:37:00.600344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 176/355] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:00 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:00.606496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:00.607479 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:00.618852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.625600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.625600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.625600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.661040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:00.668943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-be05572e-cbb6-4e42-94b3-5daa30cc56e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.166095 Nov 09 10:37:00.670437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 180/356] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:00 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:00.673813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:00.674413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:00.683281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.683680 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.684493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:00.685249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:00.704514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3c8aabbe-e05d-4a1f-9629-2cd644201462 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28587 microversion: 2.20 time: 0.096612 Nov 09 10:37:00.704514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 177/357] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:00 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28587 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:00.852617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:00.860817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7269264a-b577-445e-9e69-c8d7f591a384 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.190287 Nov 09 10:37:00.861398 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 181/358] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:00 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:01.413548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:01.414242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:01.421799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.422429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.423389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.423959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.584127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:01.593549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a0f93130-45a8-479a-8393-0f032699dcad tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1502 microversion: 2.1 time: 0.183322 Nov 09 10:37:01.593639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 178/359] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:01 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:01.617151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:01.618348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:01.625020 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.625770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.626645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.627131 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.687373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:01.688313 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:01.695915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.699403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.699403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.699403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.806093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:01.815808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-110ecaa2-6885-499d-b841-f4bcfb9d3651 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.202329 Nov 09 10:37:01.817186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 182/360] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:01 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:01.823109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:01.824510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:01.831549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.832040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.837007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.837007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.866243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:01.876822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-85425047-bf45-4092-acf5-4c11a5d7a7f8 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.194849 Nov 09 10:37:01.877856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 179/361] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:01 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:01.883039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e69ac222-b58d-450a-91cd-76e02646b95a req-033480f6-5c18-4548-ba19-1b1cad243562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948f9420-0823-4643-bc32-21636281fc3a", "name": "network-vif-plugged", "status": "completed", "tag": "a85ee1a5-296a-420d-a011-888db7794ba2"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:01.885279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:01.885279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:01.893439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e69ac222-b58d-450a-91cd-76e02646b95a req-033480f6-5c18-4548-ba19-1b1cad243562 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.893675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e69ac222-b58d-450a-91cd-76e02646b95a req-033480f6-5c18-4548-ba19-1b1cad243562 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.906136 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e69ac222-b58d-450a-91cd-76e02646b95a req-033480f6-5c18-4548-ba19-1b1cad243562 service nova] Creating event network-vif-plugged:a85ee1a5-296a-420d-a011-888db7794ba2 for instance 948f9420-0823-4643-bc32-21636281fc3a on hv-cinder-81662 Nov 09 10:37:01.910936 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e69ac222-b58d-450a-91cd-76e02646b95a req-033480f6-5c18-4548-ba19-1b1cad243562 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Nov 09 10:37:01.911537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 180/362] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:01.917219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:01.918018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:01.924188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.924749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:01.926003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:01.926853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.034929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-43f8d54c-1762-4056-a78b-c38d5873c2bd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 28612 microversion: 2.20 time: 0.215349 Nov 09 10:37:02.040245 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 183/363] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:01 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 28612 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:02.103464 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:02.111894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bce28bad-560b-4bb9-8097-dadf7ec88c81 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.198904 Nov 09 10:37:02.112523 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 181/364] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:01 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:02.611888 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:02.612742 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:02.621443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.622342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.623208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.623726 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.830369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-0fca1ec2-cb85-4d5d-8731-2672b22987e7 req-5cbf8f28-56a8-4676-8cef-23c5b2c84088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab95f416-7cfe-4634-af31-fed4de3399a3", "name": "network-vif-deleted", "tag": "448ceaab-a38a-4f15-a277-29bcf2d0c2c5"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:02.832052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:02.832052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:02.840252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0fca1ec2-cb85-4d5d-8731-2672b22987e7 req-5cbf8f28-56a8-4676-8cef-23c5b2c84088 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.840919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0fca1ec2-cb85-4d5d-8731-2672b22987e7 req-5cbf8f28-56a8-4676-8cef-23c5b2c84088 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.843093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:02.854873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3ad83b28-996c-48cb-bfb7-dc5f84b248d5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1502 microversion: 2.1 time: 0.247758 Nov 09 10:37:02.855777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 184/365] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:02 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:02.860565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:02.861175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:02.870908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-0fca1ec2-cb85-4d5d-8731-2672b22987e7 req-5cbf8f28-56a8-4676-8cef-23c5b2c84088 service nova] Creating event network-vif-deleted:448ceaab-a38a-4f15-a277-29bcf2d0c2c5 for instance ab95f416-7cfe-4634-af31-fed4de3399a3 on hv-cinder-81662 Nov 09 10:37:02.871787 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.873330 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.874164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.874656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.882785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-0fca1ec2-cb85-4d5d-8731-2672b22987e7 req-5cbf8f28-56a8-4676-8cef-23c5b2c84088 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055877 Nov 09 10:37:02.883789 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 182/366] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:02.894501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:02.895257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:02.902180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.902695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:02.903513 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:02.903993 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.014208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:03.023072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a6652862-f9aa-461a-aa39-b05d7f200a23 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.166220 Nov 09 10:37:03.023844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 185/367] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:02 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:03.045785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:03.047615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:03.048560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:03.053163 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4247eed4-9da6-4150-9b89-1ce19a34e101 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.162836 Nov 09 10:37:03.054375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 183/368] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:02 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:03.055578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.056086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.056867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.057343 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.127909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:03.128542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:03.134272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.134715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.135481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.135907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.298389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:03.306146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fe706714-4d99-4a2f-8e07-b0ff6d3fd9f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.181858 Nov 09 10:37:03.306718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 184/369] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:03 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:03.873179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:03.873832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:03.881024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.881522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.882807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:03.883236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:03.943805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:03.951924 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d93a5ada-f615-494c-b309-bbd97ffe64ec tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1460 microversion: 2.1 time: 0.082690 Nov 09 10:37:03.952607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 185/370] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:03 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1460 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:04.041630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:04.042758 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:04.049804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.050520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.051319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.051772 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.206929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:04.214556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b59b3ed6-4a02-4a45-925e-3af14f4cfa2a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.177546 Nov 09 10:37:04.215125 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 186/371] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:04 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:04.219611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:04.220237 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:04.226150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.226592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.227359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.227809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.376992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:04.385238 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b1af1c1f-ef5f-4033-9b03-7aa036428465 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.169039 Nov 09 10:37:04.385732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 187/372] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:04 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:04.390202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:04.390815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:04.397276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.397730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.398518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.398952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.546979 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:04.565122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bc9ee186-f23d-448f-af42-7fa4787eac43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.178228 Nov 09 10:37:04.565782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 188/373] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:04 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:04.969580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:04.970197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:04.977197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.977650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:04.978429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:04.978968 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.042657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:05.051702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1dd79ebd-9282-4b32-99f4-fc08a0ef421f tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1298 microversion: 2.1 time: 0.085694 Nov 09 10:37:05.052487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 189/374] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:04 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:05.114314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6a81f186-85d5-4f1e-a7c3-d92e4a63d790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 31370 microversion: 2.20 time: 2.067008 Nov 09 10:37:05.115574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 186/375] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:03 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 31370 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:37:05.231473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:05.232139 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:05.245154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.245606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.246406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.246841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.381482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:05.391020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-91817652-fc30-4f6b-b2f4-6d8bf58c494a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.163625 Nov 09 10:37:05.391644 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 190/376] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:05 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:05.403189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:05.403849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:05.410657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.411153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.411928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.412418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.547758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:05.555795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a8983321-a09d-4bef-8e24-e3c2e2c3f47b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.156674 Nov 09 10:37:05.556399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 187/377] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:05 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:05.604508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:05.605647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:05.614775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.615282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.616817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:05.617494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:05.764892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:05.772334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b322b75d-d9e4-49d0-8579-3f1f7cb1247d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.175271 Nov 09 10:37:05.772934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 191/378] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:05 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:06.068420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:06.069111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:06.075699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.076207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.078117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.078117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.108523 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.108943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.109382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lazy-loading 'fault' on Instance uuid ab95f416-7cfe-4634-af31-fed4de3399a3 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:37:06.126947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:06.128059 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:06.134824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.135282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.136089 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.136530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.150452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:06.158901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-528e60f5-6476-4583-8cfe-9bd6b87a4ba5 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 200 len: 1303 microversion: 2.1 time: 0.094031 Nov 09 10:37:06.159476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 188/379] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:06 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:06.247934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c4f82bbf-fe6d-40e3-849f-8fbf9a821ee3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 31853 microversion: 2.20 time: 0.124695 Nov 09 10:37:06.248645 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 192/380] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:06 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 31853 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:37:06.408124 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:06.408807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:06.415336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.415847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.417118 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.417118 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.551581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:06.558064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bf7a774d-896d-40c5-8de6-6a0bff44a358 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.153928 Nov 09 10:37:06.558663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 189/381] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:06 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:06.573707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:06.575704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:06.581278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.581727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.582498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.582934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.723125 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:06.731054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-24512c59-856c-4f10-ba6d-094300432919 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.161964 Nov 09 10:37:06.731665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 193/382] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:06 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:06.789789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:06.790350 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:06.796392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.799287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.799287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:06.799287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:06.939093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:06.946600 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f206ce63-beda-4c7d-b2c6-2faf1dc6ee4b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1317 microversion: 2.1 time: 0.160952 Nov 09 10:37:06.947172 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 190/383] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:06 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:07.177547 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:07.178140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: ab95f416-7cfe-4634-af31-fed4de3399a3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:07.185490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.185933 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.186718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.187146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.200769 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] HTTP exception thrown: Instance ab95f416-7cfe-4634-af31-fed4de3399a3 could not be found. Nov 09 10:37:07.201366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Returning 404 to user: Instance ab95f416-7cfe-4634-af31-fed4de3399a3 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:37:07.202262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-91439fe0-d412-411b-8071-5db32a36dbb2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3" status: 404 len: 111 microversion: 2.1 time: 0.028985 Nov 09 10:37:07.203120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 194/384] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:07 2021] GET /compute/v2.1/servers/ab95f416-7cfe-4634-af31-fed4de3399a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:37:07.260617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:07.261668 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:07.268368 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.268814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.269620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.270263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.323057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1803667918", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "f51c9ba3-bc65-47a2-b101-28e93246c8bd"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:07.363570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0f281826-dace-46a1-803b-e1a573c72aae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 32398 microversion: 2.20 time: 0.106635 Nov 09 10:37:07.364299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 191/385] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:07 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 32398 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:07.377836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] validate_networks() for [('f51c9ba3-bc65-47a2-b101-28e93246c8bd', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:37:07.575994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:07.576763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:07.584249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.584699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.586051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.586483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.731578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:07.740906 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-99d789bb-2232-4b43-adec-ffa34e5fdce3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.169346 Nov 09 10:37:07.746356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 192/386] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:07 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:07.753221 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:07.754158 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:07.760659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:37:07.761302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:37:07.762098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:37:07.763092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:37:07.763953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:37:07.764218 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.764879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.766228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.766865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.780108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.780829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.781701 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.782317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.804598 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Getting quotas for project bcca51d6c84d4962857babeca9f19d26. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:37:07.809256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Getting quotas for user e45f2b7be7df4f8e91aa9b6b9b6ecf72 and project bcca51d6c84d4962857babeca9f19d26. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:37:07.821418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:37:07.823960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:37:07.919395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:07.927316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2de554cd-8c95-4b26-b9f6-09adb576d873 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.182999 Nov 09 10:37:07.927905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 193/387] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:07 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:07.964746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:07.965354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:07.971516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.973720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:07.973720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:07.973720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.024152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-16f844b0-5fec-415d-94f1-6aacafce39ab tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705209 Nov 09 10:37:08.025656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 195/388] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:37:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 10:37:08.040347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cb29a7eb-a559-4d48-8f7f-c19c2b9d205a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:08.040982 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cb29a7eb-a559-4d48-8f7f-c19c2b9d205a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:08.131465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:08.141335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6b3f55fc-6313-4499-8c0f-f0c42aa244e1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1507 microversion: 2.1 time: 0.181025 Nov 09 10:37:08.146043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 194/389] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:07 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:08.157462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cb29a7eb-a559-4d48-8f7f-c19c2b9d205a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:08.176487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cb29a7eb-a559-4d48-8f7f-c19c2b9d205a tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1214 microversion: 2.1 time: 0.140105 Nov 09 10:37:08.180103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 196/390] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:08 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:08.366199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-9a5e2336-d039-4841-8578-6e1dcbf3ec04 req-ab8f9da0-2d41-42ce-b735-b9903abfcfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5924110-d06d-417d-9686-b288506a4155", "name": "network-vif-plugged", "status": "completed", "tag": "57025d56-126d-4a16-a8f5-a8c2b1c1acc8"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:08.368542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:08.368542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:37:08.377321 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9a5e2336-d039-4841-8578-6e1dcbf3ec04 req-ab8f9da0-2d41-42ce-b735-b9903abfcfa0 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.377763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9a5e2336-d039-4841-8578-6e1dcbf3ec04 req-ab8f9da0-2d41-42ce-b735-b9903abfcfa0 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.377964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:08.380173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:08.391037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-9a5e2336-d039-4841-8578-6e1dcbf3ec04 req-ab8f9da0-2d41-42ce-b735-b9903abfcfa0 service nova] Creating event network-vif-plugged:57025d56-126d-4a16-a8f5-a8c2b1c1acc8 for instance a5924110-d06d-417d-9686-b288506a4155 on hv-cinder-81662 Nov 09 10:37:08.392208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.393285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.394834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.395720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.396362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-9a5e2336-d039-4841-8578-6e1dcbf3ec04 req-ab8f9da0-2d41-42ce-b735-b9903abfcfa0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Nov 09 10:37:08.397999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 195/391] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:37:08.500980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dc159237-e886-4753-809a-edce99a401f4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 33366 microversion: 2.20 time: 0.129662 Nov 09 10:37:08.501774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 197/392] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:08 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 33366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:37:08.762115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:08.762811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:08.769596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.770045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.770833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.771388 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.946114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:08.946831 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:08.954316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:08.955033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.955492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.956468 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:08.957398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:08.962766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e023f525-1659-49ee-8793-c1d3fe3c01c2 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.205844 Nov 09 10:37:08.963674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 196/393] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:08 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:09.143802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:09.157897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-69fe1694-12bb-4c8a-8fa1-e8d7481d8c1b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.215819 Nov 09 10:37:09.158479 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 198/394] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:08 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:09.198514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5f1036d1-6356-4824-b6cf-207bb55374de tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:09.199488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5f1036d1-6356-4824-b6cf-207bb55374de tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:09.256201 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5f1036d1-6356-4824-b6cf-207bb55374de tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:09.263728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5f1036d1-6356-4824-b6cf-207bb55374de tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1214 microversion: 2.1 time: 0.069345 Nov 09 10:37:09.264359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 197/395] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:09 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:09.513431 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:09.514380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:09.521011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:09.521457 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:09.522249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:09.522682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:09.620950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f6325d5e-e5da-4818-9759-d05b91faa266 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 34106 microversion: 2.20 time: 0.102887 Nov 09 10:37:09.620950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 199/396] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:09 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 34106 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:09.981266 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:09.981885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:09.988247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:09.988693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:09.989465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:09.989897 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.143264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:10.152154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6f2a41b6-2ea7-4204-bfe8-7b077462af84 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1319 microversion: 2.1 time: 0.174449 Nov 09 10:37:10.164433 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 198/397] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:09 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:10.176073 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:10.177334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:10.205867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "705c8a1d-947a-403f-8b25-d5f0cff2af2b"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:10.207323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:10.213054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.214593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.214830 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.215337 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.216154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.216591 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.217573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.218998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.407685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:10.416201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2b20766f-c8f3-4afc-8e83-7b4836bb3c56 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.245136 Nov 09 10:37:10.416956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 200/398] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:10 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:10.422324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:10.423010 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:10.429659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.430086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.430958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.431608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.500849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:10.509151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9de3e6bd-db7a-4213-b742-5766b39f33e8 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1266 microversion: 2.1 time: 0.090596 Nov 09 10:37:10.509899 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 201/399] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:10 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:10.625244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:10.626148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:10.632628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.633126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.633849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:10.634278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:10.736991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1e46a4bb-45ec-4642-a263-6ab932314c99 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 34540 microversion: 2.20 time: 0.115473 Nov 09 10:37:10.737669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 202/400] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:10 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 34540 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:37:11.171881 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:11.172530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:11.179873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.180516 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.181299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.181935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.355042 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:11.367996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3b8ae8f2-02f8-4f51-8713-cb1f1684509d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1508 microversion: 2.1 time: 0.200311 Nov 09 10:37:11.368596 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 203/401] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:11 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:11.434762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:11.436873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:11.443447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.444456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.445751 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.446622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.561442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-800471f8-dc09-4b88-840d-02513de02715 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.363431 Nov 09 10:37:11.567481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 199/402] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:10 2021] POST /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments => generated 194 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:11.575244 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:11.576459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:11.584562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.585588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.586574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.587220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.649847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:11.658239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-88754b1f-fbfb-4fcf-aab5-f1f28d76bbaa tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1272 microversion: 2.1 time: 0.087880 Nov 09 10:37:11.658827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 200/403] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:11 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:11.696796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:11.710516 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c2181513-d27a-4064-9b1e-af41da956ce6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.280127 Nov 09 10:37:11.711266 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 204/404] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:11 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:11.749578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:11.750813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:11.757258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.757716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:11.758683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:11.759113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:12.676150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:12.676803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:12.683299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:12.683753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:12.684562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:12.684998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:12.815672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:12.823476 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c054c51e-da2c-4e51-8a43-0d19803c6761 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.151985 Nov 09 10:37:12.824101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 205/405] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:12 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:12.828504 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:12.829101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:12.835775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:12.836379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:12.837135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:12.837565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:12.971927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:12.979132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6ca2b6fd-c872-4681-a42f-e7f6aa5541aa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.154091 Nov 09 10:37:12.979694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 206/406] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:12 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:13.840994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:13.841893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:13.848779 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:13.849227 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:13.850011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:13.850441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:14.002155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:14.009462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-06605573-1e63-4063-85f1-e28b23546677 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.172587 Nov 09 10:37:14.010215 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 207/407] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:13 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:14.014646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:14.015252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:14.021040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:14.021489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:14.022259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:14.023230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:14.161717 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:14.168966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-30bef2ad-a754-4019-bdb2-328a6fc25265 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.157659 Nov 09 10:37:14.169531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 208/408] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:14 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:14.642190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c841447d-2351-40e3-b10e-518620871e8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 37492 microversion: 2.20 time: 2.896407 Nov 09 10:37:14.643435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 201/409] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:11 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 37492 bytes in 2898 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:15.025570 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:15.026205 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:15.032501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.032945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.033712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.034171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.186548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:15.187242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:15.194258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.194720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.195555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.196016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.267370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:15.276537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7c0c431e-0f37-4e7e-a3cb-04464d14c4f4 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.254649 Nov 09 10:37:15.277346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 209/410] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:15 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:15.343319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:15.357801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7c89c582-9e81-4615-a91e-10af9bc0e625 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.168184 Nov 09 10:37:15.357801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 202/411] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:15 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:15.523413 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-ce86b621-b774-48b6-a0fb-ba0f05bc6d41 req-1f10c8f7-4661-4241-b356-0659c697908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086d58e6-c7ac-46ce-8c58-3cde611bdd29", "tag": "5e18d512-b8f1-4c42-b97a-fb6c81cea3d6"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:15.527211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:15.527211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:15.535085 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-ce86b621-b774-48b6-a0fb-ba0f05bc6d41 req-1f10c8f7-4661-4241-b356-0659c697908d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.535615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-ce86b621-b774-48b6-a0fb-ba0f05bc6d41 req-1f10c8f7-4661-4241-b356-0659c697908d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.550002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-ce86b621-b774-48b6-a0fb-ba0f05bc6d41 req-1f10c8f7-4661-4241-b356-0659c697908d service nova] Creating event network-changed:5e18d512-b8f1-4c42-b97a-fb6c81cea3d6 for instance 086d58e6-c7ac-46ce-8c58-3cde611bdd29 on hv-cinder-81662 Nov 09 10:37:15.554975 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-ce86b621-b774-48b6-a0fb-ba0f05bc6d41 req-1f10c8f7-4661-4241-b356-0659c697908d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036852 Nov 09 10:37:15.556010 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 210/412] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:15.656856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:15.657878 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:15.665854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.666292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.667062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:15.667487 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:15.764240 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b402c7b4-cf35-4be8-b1c5-e1e1574c6c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 38130 microversion: 2.20 time: 0.110954 Nov 09 10:37:15.767002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 203/413] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:15 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 38130 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:16.294655 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:16.295388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:16.301925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.302366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.303377 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.304337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.378384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:16.382228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:16.388456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.389208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.390068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.390688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.507102 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:16.516842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e725cfe5-60bb-4c0a-9b58-9f92c921c1bd tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.226481 Nov 09 10:37:16.527294 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 211/414] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:16 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:16.579186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:16.586733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a9e680dc-8d18-4c06-8a30-a5e566aba591 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.222120 Nov 09 10:37:16.587299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 204/415] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:16 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:16.779868 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:16.781068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:16.786980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.787421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.788211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:16.788640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:16.867778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-108b5eca-da20-4bf8-a49f-6f675bd01f0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 38130 microversion: 2.20 time: 0.091622 Nov 09 10:37:16.868470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 212/416] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:16 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 38130 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:17.534436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:17.535140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:17.551187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.551759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.552919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.553769 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.608250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:17.609051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:17.617429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.617959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.619012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.619462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.721360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:17.728975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e6d21fff-f889-4f57-a16d-df01a11b2beb tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.198757 Nov 09 10:37:17.729547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 205/417] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:17 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:17.764307 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:17.772111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b985832f-0471-4023-97da-9411c04a1e9a tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.167822 Nov 09 10:37:17.772685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 213/418] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:17 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:17.883808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:17.884738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:17.891902 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.892702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.893473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:17.894194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:17.999324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ce36291d-8851-49a4-905b-6877489bd3ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 38130 microversion: 2.20 time: 0.119020 Nov 09 10:37:18.000069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 206/419] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:17 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 38130 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:18.748535 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:18.748535 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:18.756137 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:18.756137 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:18.756834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:18.757973 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:18.791391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:18.792422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:18.800023 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:18.800612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:18.801468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:18.801991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:18.902955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:18.911052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3527b9f5-b889-4b21-b6c5-8877579119c7 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.169171 Nov 09 10:37:18.912198 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 214/420] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:18 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:18.982882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:18.990487 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f5db5170-1fa9-447e-8ee1-f714bfdc772b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.203568 Nov 09 10:37:18.991059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 207/421] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:18 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:19.012631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:19.013483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:19.019915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:19.020394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:19.021362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:19.021796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:19.138858 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-649da0d8-8fa5-4b92-8467-586705cf3a17 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 38198 microversion: 2.20 time: 0.123243 Nov 09 10:37:19.138858 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 215/422] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:19 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 38198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:19.928355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:19.929471 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:19.935747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:19.936229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:19.937003 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:19.937543 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.008542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:20.009463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.016971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.017515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.018382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.018916 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.081737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:20.089868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b85535cc-31ff-4491-aeea-0e0178f98993 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.165186 Nov 09 10:37:20.090440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 208/423] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:19 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:20.148738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:20.149621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.154486 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:20.156070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.156522 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.157311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.157743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.162281 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8a8a8437-e6de-4c77-8a7f-731905519ec6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1503 microversion: 2.1 time: 0.158486 Nov 09 10:37:20.162856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 216/424] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:20 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:20.180856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "026beae7-5cee-4abb-a8af-1a966a54ebbf"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:20.181937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.190051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.196298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.196298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.196298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.218462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] HTTP exception thrown: Cannot 'attach_volume' instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 while it is in vm_state rescued Nov 09 10:37:20.225487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Returning 409 to user: Cannot 'attach_volume' instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 while it is in vm_state rescued {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:37:20.225487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-22e65842-0542-48ba-9190-87ee5cf6ca50 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043542 Nov 09 10:37:20.225487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 217/425] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:20 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 09 10:37:20.231817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:20.231817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.238294 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.238919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.239721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.240197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.291527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e3214163-c220-4aac-bce4-f6e8258421d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 200 len: 38270 microversion: 2.20 time: 0.146221 Nov 09 10:37:20.292190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 209/426] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:20 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 38270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:20.302766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:20.308376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.311641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.312172 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.312991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.313534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.338424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-70eac2ba-3f09-45ae-a8b0-ac33108a7f77 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/ips" status: 200 len: 150 microversion: 2.20 time: 0.039713 Nov 09 10:37:20.339002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 210/427] 10.222.0.35 () {60 vars in 1288 bytes} [Tue Nov 9 10:37:20 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:37:20.497879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e40447b6-55cf-4927-abbc-a46b8b3f2a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action" status: 202 len: 0 microversion: 2.1 time: 0.272071 Nov 09 10:37:20.498526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 218/428] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:37:20 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:37:20.507001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:20.508148 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:20.515109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.515540 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.516547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:20.517154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:20.686384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:20.695931 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-daa38e3f-b89e-4e10-ac84-aabdd2da0ba7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1511 microversion: 2.1 time: 0.190512 Nov 09 10:37:20.695931 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 211/429] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:20 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:21.108182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:21.109435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:21.115086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:21.115540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:21.116385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:21.116823 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:21.337114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:21.345675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-31363bea-3335-44da-8803-b7b12f1acd04 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.242851 Nov 09 10:37:21.346337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 219/430] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:21 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:21.711599 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:21.712239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:21.718639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:21.719089 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:21.719873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:21.720338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:21.855069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:21.863472 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-650a0dc5-80e4-4756-9dd9-497f85cc5e68 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1511 microversion: 2.1 time: 0.155916 Nov 09 10:37:21.864129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 212/431] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:21 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:21.877507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-b9a73f61-cabd-485e-96a9-0156f607133e req-85559343-6335-4647-a87b-d7c2e21f52c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086d58e6-c7ac-46ce-8c58-3cde611bdd29", "name": "network-vif-plugged", "status": "completed", "tag": "5e18d512-b8f1-4c42-b97a-fb6c81cea3d6"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:21.879278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:21.879278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:21.886957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-b9a73f61-cabd-485e-96a9-0156f607133e req-85559343-6335-4647-a87b-d7c2e21f52c8 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:21.887396 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-b9a73f61-cabd-485e-96a9-0156f607133e req-85559343-6335-4647-a87b-d7c2e21f52c8 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:21.899077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-b9a73f61-cabd-485e-96a9-0156f607133e req-85559343-6335-4647-a87b-d7c2e21f52c8 service nova] Creating event network-vif-plugged:5e18d512-b8f1-4c42-b97a-fb6c81cea3d6 for instance 086d58e6-c7ac-46ce-8c58-3cde611bdd29 on hv-cinder-81662 Nov 09 10:37:21.904234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-b9a73f61-cabd-485e-96a9-0156f607133e req-85559343-6335-4647-a87b-d7c2e21f52c8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030111 Nov 09 10:37:21.906364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 220/432] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:22.364035 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:22.364752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:22.372213 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:22.373207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:22.374062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:22.374562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:22.534071 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:22.541484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-87d9297e-553f-46d7-b6a1-a3b8ba824c4d tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.182446 Nov 09 10:37:22.542182 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 213/433] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:22 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:22.882079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:22.882936 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:22.899135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:22.900065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:22.900630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:22.901068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:23.143563 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:23.151863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-178b09a2-f308-4266-a026-10d580c4422d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1511 microversion: 2.1 time: 0.273829 Nov 09 10:37:23.152571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 221/434] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:22 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:23.401995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:23.402595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:23.414453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:23.415280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:23.417053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:23.417817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:23.445437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lazy-loading 'flavor' on Instance uuid e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:37:23.558218 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:23.558929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:23.564947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:23.565558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:23.566314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:23.566779 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:23.738997 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:23.751876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-832db64d-4edc-466a-8d9d-bd4a0b375bae tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1314 microversion: 2.1 time: 0.192642 Nov 09 10:37:23.759501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 222/435] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:23 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:24.148368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "705c8a1d-947a-403f-8b25-d5f0cff2af2b"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:24.164666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.175809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5fa32555-0aa7-4ad8-ba75-fe4ab3117a3b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 202 len: 0 microversion: 2.20 time: 0.777583 Nov 09 10:37:24.176574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 214/436] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:37:23 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:37:24.183637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:24.184260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.196306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.196306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.196306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.196306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.196602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.196602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.196602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.196602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.360673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Invalid volume: volume 705c8a1d-947a-403f-8b25-d5f0cff2af2b is already attached to instances: 948f9420-0823-4643-bc32-21636281fc3a Nov 09 10:37:24.367153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 400 to user: Invalid volume: volume 705c8a1d-947a-403f-8b25-d5f0cff2af2b is already attached to instances: 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:37:24.367153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-743274b0-6239-480b-9f76-94b920b444c4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.220931 Nov 09 10:37:24.367153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 223/437] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:24 2021] POST /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 09 10:37:24.386193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:24.393049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.405507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.418936 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.420006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.422182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.430984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:24.444207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d03fb921-3e41-49b7-beec-bfa7dbfd70ed tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1511 microversion: 2.1 time: 0.265543 Nov 09 10:37:24.446076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 215/438] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:24 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:24.492861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:24.493776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.500242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.500913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.501775 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.502215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.600248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'services' on Instance uuid 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:37:24.731497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:24.740347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:24.755342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:24.755342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6a41dd09-15b1-45be-abb8-a85f4538c1bc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.379259 Nov 09 10:37:24.755342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 224/439] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:24 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:24.766066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:24.766805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.775132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.775795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.777260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.777785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.858994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b17ee1d7-f423-4e87-a753-a29453035f1f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments/705c8a1d-947a-403f-8b25-d5f0cff2af2b" status: 202 len: 0 microversion: 2.1 time: 0.370745 Nov 09 10:37:24.859990 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 216/440] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:37:24 2021] DELETE /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments/705c8a1d-947a-403f-8b25-d5f0cff2af2b => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:37:24.869409 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:24.870474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:24.876964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.877424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.878188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:24.878621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:24.914044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c933add7-904e-4d84-8ae8-57c470502c12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Nov 09 10:37:24.914044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 217/441] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:37:24 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:37:25.027929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:25.042939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-36757650-1cdd-48aa-9827-f4bb6b868d10 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1497 microversion: 2.1 time: 0.280385 Nov 09 10:37:25.043531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 225/442] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:24 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:25.465222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:25.466146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:25.473086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.473612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.474462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.474959 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.615624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:25.623299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-35ae6c06-b618-4e67-85f1-f9da94912755 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1517 microversion: 2.1 time: 0.164206 Nov 09 10:37:25.625149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 218/443] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:25 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:25.776937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:25.778703 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:25.785825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.786682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.787790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.789055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.925661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:25.926767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:25.933974 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.934421 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.935520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:25.935953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:25.957376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:25.965812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:25.968315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:25.969711 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f25e79c0-09ce-4f04-9126-cbe228058412 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.210370 Nov 09 10:37:25.969846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-57567404-fc09-4273-b05a-f0f854a7b712 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048213 Nov 09 10:37:25.970316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 219/445] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:37:25 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:25.980146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 226/445] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:25 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:26.778203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:26.778758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:26.785430 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:26.785875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:26.788205 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:26.788205 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:26.819757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:37:26.980747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:26.981882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:26.988496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:26.988958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:26.989770 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:26.990203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.021653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6c21eb66-1c9b-4aca-9081-4398c78a76f1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044598 Nov 09 10:37:27.022415 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 227/446] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:37:26 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:37:27.027196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:27.027803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:27.034017 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.034471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.035260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.035704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.183529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:27.192615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:27.195020 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:27.196619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-85a28c90-de8c-403e-a7d3-5456701565e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.172760 Nov 09 10:37:27.197509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 228/447] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:27 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:27.227797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2017431129", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "5554d1a8-4766-4ee1-bd4f-871198ca55f6"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:27.236730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5322f18f-9195-4f54-a363-5c2b4331adf6 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "DELETE /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 204 len: 0 microversion: 2.1 time: 0.461935 Nov 09 10:37:27.237730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 220/448] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:37:26 2021] DELETE /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:37:27.246235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:27.246949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:27.263086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.272502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.272502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.272502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.313284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] validate_networks() for [('5554d1a8-4766-4ee1-bd4f-871198ca55f6', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:37:27.454733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:27.462711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c256af81-d88e-4edb-91df-6c40aa0d8862 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1503 microversion: 2.1 time: 0.220340 Nov 09 10:37:27.463291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 221/449] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:27 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:27.468093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:27.468952 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:27.475294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.476171 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.477162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.477796 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.633189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:27.640848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b2416990-9ec6-49be-9bb8-a1345391c8ac tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1517 microversion: 2.1 time: 0.176052 Nov 09 10:37:27.656349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 222/450] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:27 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:27.658093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f07675a0-4c77-4683-8f22-54c6dd1d449c"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:27.659393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:27.666005 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.666453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.667241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.667678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.770680 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:37:27.771522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:37:27.772106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:37:27.772616 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:37:27.773128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:37:27.781935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.782592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.787229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:27.787229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:27.810106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:37:27.814744 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Getting quotas for user 1a255547966e430bac7a2b4d0c0727b1 and project 39b4a5ce13d4496f8a0f0a50d852098e. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:37:27.829796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:37:27.832752 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:37:27.987194 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2b895bfb-b2ed-4825-bad2-f0618392c551 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764091 Nov 09 10:37:27.992952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 229/451] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:37:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:37:27.997909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-39b83c26-79e6-4744-884f-82ec3d09d967 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:27.998648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-39b83c26-79e6-4744-884f-82ec3d09d967 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:28.105375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-39b83c26-79e6-4744-884f-82ec3d09d967 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:28.113841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-39b83c26-79e6-4744-884f-82ec3d09d967 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1218 microversion: 2.1 time: 0.118789 Nov 09 10:37:28.116451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 230/452] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:27 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:28.215917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:28.216506 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:28.222388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:28.222824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:28.223587 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:28.224040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:28.436743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:28.445756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:28.447317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:28.448860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a333ad70-29b6-4886-befa-1790bb2ae111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.236738 Nov 09 10:37:28.463306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 231/453] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:28 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:37:28.481050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:28.481672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:28.487872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:28.488614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:28.489574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:28.490168 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:28.649730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:28.683348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b437ca3a-d3e9-42d6-b688-7439f0856287 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.029121 Nov 09 10:37:28.686977 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 223/454] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:27 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 194 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:28.692585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-75b7f5da-0af8-4492-8429-c155cb429055 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1503 microversion: 2.1 time: 0.216116 Nov 09 10:37:28.693182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 232/455] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:28 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:29.132990 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:29.133734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:29.141944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.142385 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.143739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.144359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.225008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:29.233304 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-26742bb7-c81e-4774-8fea-49e0e90ecd7f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1222 microversion: 2.1 time: 0.104483 Nov 09 10:37:29.233874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 224/456] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:29 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:29.473648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:29.474343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:29.481969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.482419 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.483420 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.483862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.710634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:29.711846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:29.717854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.718490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.719415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:29.720058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:29.737778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:29.746127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:29.747894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:29.749104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8d00b488-8b0d-4012-962a-7622bd4196cc tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.279285 Nov 09 10:37:29.749672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 233/457] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:29 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:29.904059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:29.912179 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d067f31f-1bdd-4651-8cde-abcbc0d233f2 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1503 microversion: 2.1 time: 0.205191 Nov 09 10:37:29.912288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 225/458] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:29 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:30.133366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-0879738e-d61a-450d-9f24-8b75e56b3674 req-c12b244a-bc39-474d-9a8f-7581c012cd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086d58e6-c7ac-46ce-8c58-3cde611bdd29", "name": "network-vif-deleted", "tag": "5e18d512-b8f1-4c42-b97a-fb6c81cea3d6"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:30.140660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:30.140660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:30.149256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0879738e-d61a-450d-9f24-8b75e56b3674 req-c12b244a-bc39-474d-9a8f-7581c012cd05 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.149692 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0879738e-d61a-450d-9f24-8b75e56b3674 req-c12b244a-bc39-474d-9a8f-7581c012cd05 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.161120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-0879738e-d61a-450d-9f24-8b75e56b3674 req-c12b244a-bc39-474d-9a8f-7581c012cd05 service nova] Creating event network-vif-deleted:5e18d512-b8f1-4c42-b97a-fb6c81cea3d6 for instance 086d58e6-c7ac-46ce-8c58-3cde611bdd29 on hv-cinder-81662 Nov 09 10:37:30.166116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-0879738e-d61a-450d-9f24-8b75e56b3674 req-c12b244a-bc39-474d-9a8f-7581c012cd05 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037120 Nov 09 10:37:30.166715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 234/459] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:30.253955 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:30.255037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:30.266653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.267228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.268110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.268584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.335172 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:30.345294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-48842aad-36e6-423b-ba57-eaecfdbea34a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1270 microversion: 2.1 time: 0.098156 Nov 09 10:37:30.345883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 226/460] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:30 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:30.774440 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:30.775138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:30.781850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.782295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.783118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.783576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.934198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:30.934833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:30.942388 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.942821 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.943849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.944349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.977645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:30.978085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:30.978564 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lazy-loading 'fault' on Instance uuid 086d58e6-c7ac-46ce-8c58-3cde611bdd29 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:37:31.031838 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:31.036192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e45f2b7be7df4f8e91aa9b6b9b6ecf72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcca51d6c84d4962857babeca9f19d26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:31.041372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:31.046125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4c2168c5-8e2c-4e6e-82e2-59ef7fec297b tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 200 len: 1304 microversion: 2.1 time: 0.121834 Nov 09 10:37:31.056063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 227/461] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:30 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:31.058605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:31.060032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f3b397f3-655b-4505-8370-35c8a8eea80d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.290637 Nov 09 10:37:31.061273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 235/462] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:30 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:31.362571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:31.363280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:31.369860 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:31.370934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:31.371319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:31.371764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:31.434595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:31.442266 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5dea46b5-296e-45e1-8b26-5356eb68389d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1276 microversion: 2.1 time: 0.083618 Nov 09 10:37:31.442843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 228/463] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:31 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:32.062424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:32.063038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] [instance: 086d58e6-c7ac-46ce-8c58-3cde611bdd29] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:32.070949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.073018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.074016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.074462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.089975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:32.091409 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:32.091734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] HTTP exception thrown: Instance 086d58e6-c7ac-46ce-8c58-3cde611bdd29 could not be found. Nov 09 10:37:32.092306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] Returning 404 to user: Instance 086d58e6-c7ac-46ce-8c58-3cde611bdd29 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:37:32.093296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-49007004-a306-41bb-ae57-27c77d4c29a0 tempest-VolumesActionsTest-2107592728 tempest-VolumesActionsTest-2107592728-project] 10.222.0.35 "GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29" status: 404 len: 111 microversion: 2.1 time: 0.034588 Nov 09 10:37:32.094175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 236/464] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:32 2021] GET /compute/v2.1/servers/086d58e6-c7ac-46ce-8c58-3cde611bdd29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:37:32.101262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.101932 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.102723 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.103443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.263532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:32.274057 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:32.275648 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:32.276883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0297c661-7744-497c-9c3d-c9e2a00a1ae2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.194803 Nov 09 10:37:32.277512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 229/465] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:32 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:32.462029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:32.462647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:32.469139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-a8413221-46ba-4975-af98-f046ab5d594a req-ae4ea2af-30c3-4237-b0a3-25ba7fa3e84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495f1d34-e224-4dc2-a812-f8f1186558ab", "tag": "be7f1284-1ab8-4d35-a9f8-08db1bc7a60e"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:32.469496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.469855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.471267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:32.471267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:37:32.471457 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.471457 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.480702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-a8413221-46ba-4975-af98-f046ab5d594a req-ae4ea2af-30c3-4237-b0a3-25ba7fa3e84d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:32.481142 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-a8413221-46ba-4975-af98-f046ab5d594a req-ae4ea2af-30c3-4237-b0a3-25ba7fa3e84d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:32.495138 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-a8413221-46ba-4975-af98-f046ab5d594a req-ae4ea2af-30c3-4237-b0a3-25ba7fa3e84d service nova] Creating event network-changed:be7f1284-1ab8-4d35-a9f8-08db1bc7a60e for instance 495f1d34-e224-4dc2-a812-f8f1186558ab on hv-cinder-81662 Nov 09 10:37:32.500298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-a8413221-46ba-4975-af98-f046ab5d594a req-ae4ea2af-30c3-4237-b0a3-25ba7fa3e84d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 Nov 09 10:37:32.500899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 230/466] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:32.702320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:32.710421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-21cc4c22-0ce1-4615-8588-82485b464495 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.252023 Nov 09 10:37:32.711013 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 237/467] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:32 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:33.300739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:33.301442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:33.310338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:33.311192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:33.312968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:33.313599 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:33.469504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:33.478454 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:33.480091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:33.492142 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a7e08011-d721-46d6-8c70-e09225fcfef4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.189209 Nov 09 10:37:33.492142 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 231/468] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:33 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:33.727662 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:33.728306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:33.734601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:33.734986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:33.735756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:33.736223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:33.882697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:33.890378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3fad4206-e571-4f74-b50b-e2c687d9a67b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.166755 Nov 09 10:37:33.891141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 238/469] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:33 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:34.503052 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:34.503653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:34.510003 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:34.510448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:34.511245 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:34.511678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:34.643325 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:34.651120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:34.652682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:34.653838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d8230ced-64f9-45d8-8ac5-b41c6affae74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.154491 Nov 09 10:37:34.654399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 232/470] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:34 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:34.907702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:34.908368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:34.915346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:34.915795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:34.916606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:34.917043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:35.055187 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:35.062357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5c139ac1-95d5-44f8-a193-fd286c960ede tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.158352 Nov 09 10:37:35.062918 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 239/471] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:34 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:35.672697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:35.673234 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:35.681419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:35.682321 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:35.685664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:35.685664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:35.820938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:35.829569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:35.831082 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:35.832290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8375804b-ff46-43f7-a9ce-d19749fc9349 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.163468 Nov 09 10:37:35.832870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 233/472] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:35 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:36.084637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:36.085319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:36.092304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:36.092750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:36.093530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:36.093963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:36.227144 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:36.234699 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b421d899-6bb2-4b5c-a7bf-bba792873ad4 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.155186 Nov 09 10:37:36.235267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 240/473] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:36 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:36.850418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:36.851032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:36.857336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:36.857785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:36.858565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:36.859001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:36.993171 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:37.001087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:37.002600 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:37.003759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-effa252c-d3d9-487c-999b-d644a93cfb94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.157063 Nov 09 10:37:37.004353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 234/474] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:36 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:37.251517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:37.252171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:37.259235 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:37.259759 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:37.261051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:37.261572 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:37.393807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:37.404072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f790ee8c-11cb-40e4-a443-5f0f0e6f9428 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.153533 Nov 09 10:37:37.404072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 241/475] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:37 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:38.023281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:38.023929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:38.030101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:38.030549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:38.031324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:38.031759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:38.169038 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:38.177233 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:38.178834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:38.180050 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cc2dcdc8-fda8-40a5-a14a-a467cf8f3d5a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.161236 Nov 09 10:37:38.180974 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 235/476] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:38 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:38.419217 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:38.419838 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:38.426300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:38.426747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:38.427576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:38.428032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:38.571684 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:38.579281 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-488be08c-1197-457e-b690-273c7833ec77 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.164813 Nov 09 10:37:38.579850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 242/477] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:38 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:39.209449 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:39.210584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:39.216915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.217359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.218349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.218788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.471173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:39.503055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:39.508790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:39.510824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a628ab97-fedc-493c-9bd6-abcbb6e33aba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.305001 Nov 09 10:37:39.511666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 236/478] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:39 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:37:39.545896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:39.547958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:39.572566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.573804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.576937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.577460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.596575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:39.597943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:39.617622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.618243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.619041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:39.619534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:39.670927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'flavor' on Instance uuid 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:37:39.895240 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:39.903440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-300d8afa-0be6-4bf5-8f2d-c1a0e006e302 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.311260 Nov 09 10:37:39.905359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 237/479] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:39 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:40.222433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-25743e64-32b8-4245-8214-17dc2ab48115 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action" status: 200 len: 32 microversion: 2.1 time: 0.682822 Nov 09 10:37:40.222433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 243/480] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:37:39 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action => generated 32 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:37:40.244230 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:40.245872 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:40.264159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.264639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:40.265606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.266067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:40.475026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:40.488978 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-53fb66e6-cc84-4858-a20f-6e3634bc0598 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.250874 Nov 09 10:37:40.490533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 238/481] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:40 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:40.542508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:40.542508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:40.546687 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.550211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:40.559091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.559091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:40.837277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:40.845032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:40.846557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:40.847726 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c532b4b8-14ec-488c-b1d2-c9a9745ab92f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.321903 Nov 09 10:37:40.848323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 244/482] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:40 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:40.923239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:40.924179 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:40.935943 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.936411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:40.937503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:40.938746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:41.139860 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:41.150278 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8a50b114-cc6a-43f9-8a9b-69e774317af3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.231635 Nov 09 10:37:41.151223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 239/483] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:40 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:41.516348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:41.517395 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:41.524690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:41.525591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:41.526660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:41.527342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:41.710248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:41.719757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ffe5b178-68d4-46a4-93cd-dee5ff04f6c5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.207074 Nov 09 10:37:41.720368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 245/484] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:41 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:41.865713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:41.866351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:41.873920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:41.874584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:41.875622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:41.876236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:42.120523 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:42.132551 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:42.134277 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:42.136086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ab206d01-613d-4cd5-8854-ca4db2f740c8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.274207 Nov 09 10:37:42.137294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 240/485] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:41 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:42.167055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:42.167657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:42.175006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:42.175575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:42.176412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:42.176855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:42.371097 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:42.381149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6354d0b2-4c42-4faf-ae60-17ff1e7eb632 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.218298 Nov 09 10:37:42.382046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 246/486] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:42 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:42.736650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:42.737348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:42.743382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:42.743929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:42.744735 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:42.745167 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:42.878872 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:42.887355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-693a6840-46ed-4e2d-8fe1-44443056ffdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.154276 Nov 09 10:37:42.887923 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 241/487] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:42 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:43.154756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:43.155379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:43.168037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.168037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:43.168037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.168037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:43.398864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:43.401510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:43.404850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:43.408777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.408947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:43.409349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:43.410186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.410657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:43.410784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:43.411941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cbaac9f8-4b6c-42cb-862a-0945fccce05c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.261527 Nov 09 10:37:43.412566 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 247/488] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:43 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:37:43.555521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:43.569668 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3a1a7eca-ddc5-4fb1-bb51-edb3f1e6fc60 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.172180 Nov 09 10:37:43.591453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 242/489] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:43 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:43.905385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:43.906372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:43.932114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.932114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:43.932114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:43.932114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.183110 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:44.203636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3e91585f-1df9-44b0-94d2-4216c5fc549d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.302911 Nov 09 10:37:44.206204 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 248/490] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:43 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:44.327835 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-3c771203-b282-4c3a-8e16-a89fd73e41d5 req-9b20e624-7444-43d4-bf16-866434e599e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495f1d34-e224-4dc2-a812-f8f1186558ab", "name": "network-vif-plugged", "status": "completed", "tag": "be7f1284-1ab8-4d35-a9f8-08db1bc7a60e"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:44.340598 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:44.340598 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:37:44.353781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-3c771203-b282-4c3a-8e16-a89fd73e41d5 req-9b20e624-7444-43d4-bf16-866434e599e4 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.354223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-3c771203-b282-4c3a-8e16-a89fd73e41d5 req-9b20e624-7444-43d4-bf16-866434e599e4 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.370556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-3c771203-b282-4c3a-8e16-a89fd73e41d5 req-9b20e624-7444-43d4-bf16-866434e599e4 service nova] Creating event network-vif-plugged:be7f1284-1ab8-4d35-a9f8-08db1bc7a60e for instance 495f1d34-e224-4dc2-a812-f8f1186558ab on hv-cinder-81662 Nov 09 10:37:44.376877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-3c771203-b282-4c3a-8e16-a89fd73e41d5 req-9b20e624-7444-43d4-bf16-866434e599e4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052677 Nov 09 10:37:44.382566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 243/491] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:44.431057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:44.439809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:44.446608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.447664 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.449110 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.449904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.535957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68e09d84-749c-4233-be15-719cfea9a3fd", "device": "/dev/sdb"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:44.539298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:44.546935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.548807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.548807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.549530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.726308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:44.740187 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:44.742239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:44.744232 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a05a355b-385e-4d2f-a243-4067111392eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1741 microversion: 2.20 time: 0.317281 Nov 09 10:37:44.745447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 249/492] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:44 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:44.750683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:44.753985 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:44.760120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.761170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:44.762142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:44.762752 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:45.063412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:45.072134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-01eab692-b0da-47b0-b45a-b2629447a868 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.325356 Nov 09 10:37:45.072701 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 250/493] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:44 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:45.223512 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:45.224256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:45.231063 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:45.231508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:45.232335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:45.232939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:45.433290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:45.446764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d3367c16-4679-4fa0-96b5-6c1669906059 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.226925 Nov 09 10:37:45.457305 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 251/494] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:45 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:45.607586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-85a13b00-d448-4829-b1d2-5518330a4fc6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "POST /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077613 Nov 09 10:37:45.608976 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 244/495] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:44 2021] POST /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:37:45.763608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:45.765002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:45.774211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:45.775880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:45.779245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:45.779767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:45.999750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:46.014349 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:46.016605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:46.018658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9c148d04-4767-4640-9218-c3a6b4d3a8de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1741 microversion: 2.20 time: 0.259046 Nov 09 10:37:46.019806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 252/496] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:45 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:46.093879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:46.094628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:46.104931 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:46.105732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:46.106790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:46.107313 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:46.272692 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:46.281056 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-50abc70b-46d8-481a-bbef-339529b1c299 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.191792 Nov 09 10:37:46.281692 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 245/497] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:46 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:46.392674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-8a923f38-1fd3-4d6a-933e-934b6788ee05 req-b461221c-bc2a-4e8d-8043-10f02268590c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "name": "network-vif-plugged", "status": "completed", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:46.394447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:37:46.394447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:37:46.401371 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8a923f38-1fd3-4d6a-933e-934b6788ee05 req-b461221c-bc2a-4e8d-8043-10f02268590c service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:46.401803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8a923f38-1fd3-4d6a-933e-934b6788ee05 req-b461221c-bc2a-4e8d-8043-10f02268590c service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:46.414236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-8a923f38-1fd3-4d6a-933e-934b6788ee05 req-b461221c-bc2a-4e8d-8043-10f02268590c service nova] Creating event network-vif-plugged:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:37:46.419856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-8a923f38-1fd3-4d6a-933e-934b6788ee05 req-b461221c-bc2a-4e8d-8043-10f02268590c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 Nov 09 10:37:46.420961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 253/498] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:37:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:37:46.464473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:46.467356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:46.473828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:46.474627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:46.476124 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:46.476746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:46.621929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:46.631272 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d4560bdd-a5da-43ef-a2de-94e867f9a52c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.170342 Nov 09 10:37:46.632294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 246/499] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:46 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:47.037994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:47.039247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:47.046214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.046660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.047461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.047891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.227470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:47.236560 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:47.239147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:47.239992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-89772375-220c-4cc1-9286-dbd124a7ccca tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1741 microversion: 2.20 time: 0.206086 Nov 09 10:37:47.248127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 254/500] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:47 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:47.298493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:47.299199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:47.306937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.308256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.309504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.311262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.468831 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:47.477271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-264eedba-416d-4645-8c42-a6797e650fce tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1318 microversion: 2.1 time: 0.183314 Nov 09 10:37:47.478223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 247/501] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:47 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:47.650057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:47.650775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:47.660612 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.661074 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.661947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:47.662611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:47.852234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:47.858156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-214585a4-55d1-4936-85a2-7ab4914a05c1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.213439 Nov 09 10:37:47.859098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 255/502] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:47 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:48.259226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:48.260490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:48.266884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.267330 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:48.268140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.268600 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:48.427085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:48.435706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:48.444816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:48.444816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2ef51882-3aa8-4c3b-9a5e-8f5f76a75dfe tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.183190 Nov 09 10:37:48.444816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 248/503] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:48 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:48.496273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:48.496273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:48.502390 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.502835 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:48.503807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.504270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:48.687611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:48.687611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8c377f25-a0f3-480c-8f92-cefbc37e9634 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1508 microversion: 2.1 time: 0.195015 Nov 09 10:37:48.687611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 256/504] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:48 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:48.876029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:48.876679 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:48.883167 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.883611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:48.885306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:48.885306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:49.032280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:49.045227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-61c549c0-0d33-482f-8821-59ca37915b5e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.173077 Nov 09 10:37:49.045814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 249/505] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:48 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:49.457465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:49.458130 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:49.466976 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:49.468123 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:49.469105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:49.469700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:49.628354 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:49.644037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:49.645664 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:49.646943 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-40054f16-56f3-4b83-926c-26722a38502d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.193281 Nov 09 10:37:49.658706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 257/506] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:49 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:50.062874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:50.063450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:50.073850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.074570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.075085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.075570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.237347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:50.246984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7a3e745f-c494-4b17-be07-251a73d7aac5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.187954 Nov 09 10:37:50.247841 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 250/507] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:50 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:50.666880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:50.668432 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:50.686244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.686244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.686244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.686244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.773831 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa581707-50c7-414d-b537-5be67b05f445"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:37:50.775060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:50.782194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.782647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.783704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:50.784190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:50.862967 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:50.877294 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:50.879051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:50.881076 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-eea50e1a-36f3-4b6d-b390-77c789383f3d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.218488 Nov 09 10:37:50.894925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 258/508] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:50 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:51.266898 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:51.268221 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:51.275149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:51.276101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:51.276908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:51.277501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:51.438348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:51.450030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2d7db3ea-a424-473b-abfa-bf72bd7c7164 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.186599 Nov 09 10:37:51.450030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 259/509] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:51 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:51.624691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-543aa3d2-2825-4532-ac41-7b9bde3deabf tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "POST /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854676 Nov 09 10:37:51.625743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 251/510] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:37:50 2021] POST /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 194 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:37:51.902200 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:51.903371 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:51.909937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:51.910390 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:51.911197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:51.911633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:52.112718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:52.127023 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:52.128072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:52.129292 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-279a2a8e-ea32-4c24-b239-393dd48a5250 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.232279 Nov 09 10:37:52.140018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 260/511] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:51 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:52.467417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:52.468146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:52.475143 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:52.476149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:52.476950 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:52.477394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:52.698492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:52.716569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-17f94d74-963a-49b2-a4f8-e2e4a997c5b1 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.253166 Nov 09 10:37:52.716984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 252/512] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:52 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:37:53.150241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:53.151849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:53.159849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:53.160320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:53.162828 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:53.162828 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:53.398192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:53.405677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:53.407239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:53.408498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-df66e617-9051-45bc-a05b-13ef95216cc7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.263355 Nov 09 10:37:53.412009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 261/513] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:53 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:53.737768 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:53.738429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:53.745186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:53.746758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:53.746758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:53.746972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:53.908908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:53.917377 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-941f122b-8dd2-4cb1-a2ba-b6fb0d5b711d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.183284 Nov 09 10:37:53.918173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 253/514] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:53 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:54.428343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:54.429471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:54.436789 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:54.437230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:54.438527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:54.439001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:54.592197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:54.602262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:54.604034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:54.605430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fb4a4c9b-bf00-410f-bd9d-306b2756fafb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.180772 Nov 09 10:37:54.606158 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 262/515] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:54 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:37:54.935656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:54.937146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:54.957493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:54.958325 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:54.959431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:54.960563 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:55.144090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:55.152468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d937d5e3-5223-4fe5-838a-b88e0ffc5b99 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.221905 Nov 09 10:37:55.158856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 254/516] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:54 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:55.625532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:55.626937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:55.633798 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:55.634628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:55.635713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:55.636421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:55.790871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:55.805014 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:55.806719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:55.807580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-48117be6-655b-4a05-ad89-275401095e57 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.186141 Nov 09 10:37:55.808156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 263/517] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:55 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:56.171418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:56.172879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:56.183506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:56.183986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:56.185207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:56.185711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:56.398666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:56.407620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2c9ffd56-75f7-4604-bc90-796a8fd48166 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.240055 Nov 09 10:37:56.408377 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 255/518] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:56 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:56.826970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:56.827490 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:56.838849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:56.849639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:56.849639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:56.849639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:57.048052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:57.063381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:57.067397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:57.070948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d59b4149-1d6e-4cd7-8482-0939de3722c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.247098 Nov 09 10:37:57.072862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 264/519] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:56 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:37:57.424842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:57.425470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:57.433323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:57.433773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:57.434556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:57.434985 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:57.589801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:57.598290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a6413332-d5f8-43c2-9078-a0852cbec6dd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.177114 Nov 09 10:37:57.598853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 256/520] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:57 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:58.104418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:58.105048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:58.113572 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:58.114217 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:58.115185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:58.116376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:58.271439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:58.281521 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:58.283388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:58.284662 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cc6f9b8d-ee5a-4714-b334-d16b520aa885 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.185762 Nov 09 10:37:58.288544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 265/521] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:58 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:58.615380 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:58.616702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:58.623507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:58.623947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:58.624928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:58.625359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:58.808907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:58.818322 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3a911ecb-cc05-46b1-88b5-fa2628efcfdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.206367 Nov 09 10:37:58.819790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 257/522] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:58 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:37:59.304224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:59.304764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:59.310778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:59.311219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:59.311996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:59.312430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:59.448313 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:59.456270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:59.457765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:37:59.458903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-048e6631-8c5c-46f8-b530-5c4db8b9840d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.159197 Nov 09 10:37:59.459456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 266/523] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:37:59 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:37:59.836595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:37:59.837431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:37:59.844463 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:59.845290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:59.846177 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:37:59.846664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:37:59.992730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:00.001636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-22923ac9-069f-4511-8539-1bd8584fdf74 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.169683 Nov 09 10:38:00.002203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 258/524] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:37:59 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:00.486704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:00.486704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:00.486704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:00.486704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:00.488696 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:00.491806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:00.670132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:00.687691 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:00.692712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:00.692712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0f620dfd-a805-4a69-a0b2-c2ce81e2770a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.217122 Nov 09 10:38:00.692712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 267/525] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:00 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:01.018998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:01.020316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:01.027557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.028224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.029088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.029769 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.221448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:01.235930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7fa1471d-9c5b-4e54-ad3b-6606c3f1a03f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.221172 Nov 09 10:38:01.237359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 259/526] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:01 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:01.576594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:01.576594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:01.581450 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.581912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.582914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.583483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.729854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:01.731265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:01.739235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.739884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.741889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'services' on Instance uuid 495f1d34-e224-4dc2-a812-f8f1186558ab {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:01.742174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:01.742996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:01.901670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:01.910087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:01.912652 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:01.914127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1dd65100-efab-42d3-94ef-9596927e4f49 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.188237 Nov 09 10:38:01.923679 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 260/527] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:01 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:02.014466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d5b86ad8-24d5-42c4-b0f4-ac7bf80a9588 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments/aa581707-50c7-414d-b537-5be67b05f445" status: 202 len: 0 microversion: 2.1 time: 0.445164 Nov 09 10:38:02.015082 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 268/528] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:38:01 2021] DELETE /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments/aa581707-50c7-414d-b537-5be67b05f445 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:38:02.023737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:02.024740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:02.031715 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.032187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:02.033001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.033429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:02.069537 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c664a314-e752-4b4e-a40d-0087751a7019 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Nov 09 10:38:02.070291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 261/529] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:02 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:02.254590 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:02.255654 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:02.262141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.262508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:02.263499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.264222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:02.412408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:02.422369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-237262fc-5d4a-476a-9430-f5fc210d463f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.171801 Nov 09 10:38:02.423030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 269/530] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:02 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:02.933485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:02.934427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:02.941212 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.941797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:02.942818 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:02.943524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:03.082940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:03.085581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:03.090404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:03.092862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:03.093308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:03.094122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:03.094550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:03.099087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:03.101004 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:03.102448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-aaf0acc2-90f7-433b-99ee-61d4be18db42 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.173295 Nov 09 10:38:03.103303 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 262/531] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:02 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:03.127801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b18739c5-5d33-40bb-bc22-8cb7c26b5cda tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 Nov 09 10:38:03.132151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 270/532] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:03 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:03.449952 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:03.450661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:03.457418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:03.458129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:03.459112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:03.459750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:03.610994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:03.621303 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a8dbc32c-30d0-4e34-a758-87f1d299eb21 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.185038 Nov 09 10:38:03.622594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 263/533] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:03 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:04.120710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:04.121380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:04.128800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.129554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.130355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.130794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.140528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:04.141462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:04.157760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.158215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.159037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.159475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.199647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c8428364-32fe-48d9-be9d-5becc9daccac tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062760 Nov 09 10:38:04.200248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 264/534] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:04 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:04.294122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:04.303321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:04.304823 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:04.306322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fa67cdae-9f90-4729-8d8e-fac050fcd614 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.189653 Nov 09 10:38:04.307099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 271/535] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:04 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:04.639030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:04.640061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:04.646647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.647780 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.648822 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:04.649287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:04.819774 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:04.830381 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2be0dc31-c2c8-4389-bcc2-05212f2a2fdd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.194375 Nov 09 10:38:04.841427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 265/536] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:04 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:05.211952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:05.213171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:05.220443 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.220885 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.221865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.222296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.258620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e929fe50-cb58-4ae5-9f0e-6ea9586c2643 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051614 Nov 09 10:38:05.259749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 272/537] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:05 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:05.325361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:05.326801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:05.334267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.335692 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.336821 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.337559 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.471293 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:05.479281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:05.480867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:05.482034 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-efc6e353-ae52-48f0-806c-94e601cb212d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.160734 Nov 09 10:38:05.482608 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 266/538] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:05 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:05.849464 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:05.850593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:05.856328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.856779 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.857543 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:05.857972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:05.989720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:05.998459 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-91f4c49a-72fa-41d0-a3cb-b0c397745a10 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.152559 Nov 09 10:38:05.998953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 273/539] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:05 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:06.271069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:06.272534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:06.278733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:06.279183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:06.279992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:06.280429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:06.311923 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-20897f78-8dd2-495f-9517-36eb634b634d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Nov 09 10:38:06.312554 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 267/540] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:06 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:06.501698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:06.502998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:06.509292 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:06.509996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:06.510778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:06.511221 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:06.671622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:06.681677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:06.684262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:06.686241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dd7018aa-0247-48b1-8eae-06491e051069 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.188713 Nov 09 10:38:06.687149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 274/541] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:06 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:07.017654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:07.020821 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:07.027569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.027569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.028055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.028318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.175473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:07.183261 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c8b94d60-dc51-4279-8ce9-992d74f4810f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.170936 Nov 09 10:38:07.183831 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 268/542] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:07 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:07.324081 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:07.325456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:07.332439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.333216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.335054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.335718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.375287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7f276e10-2c8d-4ba0-bbab-8c0495a93907 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054675 Nov 09 10:38:07.376779 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 275/543] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:07 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:07.706647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:07.707301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:07.714363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.714810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.715587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:07.716040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:07.846651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:07.854506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:07.856032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:07.857175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2d0b497f-ef7d-4a9e-8c5f-66a5fbfe90ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.154349 Nov 09 10:38:07.857728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 269/544] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:07 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:08.200284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:08.200953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:08.207466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.207916 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:08.208731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.209169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:08.363098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:08.379481 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-853ce2fb-e016-4578-9783-f4e288d7a66b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.183039 Nov 09 10:38:08.388575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:08.389218 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 276/545] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:08 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:08.389575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:08.396150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.396594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:08.397405 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.397829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:08.433362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8e0c6728-cf3e-4ffc-a8bd-4344a350508d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048777 Nov 09 10:38:08.433992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 270/546] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:08 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:08.875528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:08.876285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:08.882674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.883114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:08.884192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:08.884622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:09.027981 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:09.035785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:09.037255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:09.038412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fba45440-14bc-40a1-9f42-0437598003f2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.167091 Nov 09 10:38:09.038961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 277/547] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:08 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:09.397689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:09.399139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:09.405846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:09.406484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:09.407459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:09.408088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:09.446680 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:09.448815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:09.455916 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:09.456541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:09.457433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:09.458137 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:09.502536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d2cb9025-6679-4c27-a432-8c0175da5436 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061276 Nov 09 10:38:09.509133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 278/548] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:09 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:09.551294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:09.560631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4e38d6a0-3fff-4316-b348-ee94ed7b693d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.166545 Nov 09 10:38:09.570825 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 271/549] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:09 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:10.060554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:10.061565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:10.071104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.072342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.073309 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.074391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.237389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:10.246561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:10.248432 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:10.249688 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b075e2ce-60d1-4c4d-96c4-c842cdd0cde0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.195836 Nov 09 10:38:10.250461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 279/550] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:10 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:10.517270 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:10.518777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:10.528115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.528851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.529674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.530109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.561611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2e3738ad-2c8c-4219-9a0e-46d3da9e5695 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Nov 09 10:38:10.562815 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 272/551] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:10 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:10.578618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:10.588101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:10.588101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.588101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.588578 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:10.589018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:10.828444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:10.835300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-18a49c4c-fbbd-4a4d-a71d-df376faa2ef9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.260613 Nov 09 10:38:10.836530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 280/552] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:10 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:11.269041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:11.269645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:11.277160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.277787 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:11.278823 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.279417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:11.433644 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:11.444146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:11.446105 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:11.447289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9922b514-d7b2-4410-a054-09b2db99cb1b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.182013 Nov 09 10:38:11.448201 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 273/553] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:11 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:11.575822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:11.576834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:11.583944 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.585207 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:11.585716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.586146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:11.623329 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-edbf8d27-f491-47dd-b733-1c1594b18d89 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053171 Nov 09 10:38:11.624393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 281/554] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:11 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:11.911989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:11.911989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:11.911989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.911989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:11.912743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:11.912743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:12.027533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:12.035848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-49b61b26-43ca-451b-9ad4-c19ffe34fcc4 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.186201 Nov 09 10:38:12.036495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 274/555] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:11 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:12.466429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:12.467035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:12.473861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:12.476842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:12.476842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:12.476842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:12.634656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:12.635619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:12.635619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:12.641768 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:12.642221 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:12.643073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:12.643182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:12.643565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:12.644667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:12.645841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ad9ce0bd-7409-478c-88c6-a410abd621d2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.183206 Nov 09 10:38:12.646617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 282/556] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:12 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:12.679512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0fb37b76-73cc-44c4-be51-82183f98fcec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048568 Nov 09 10:38:12.680202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 275/557] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:12 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:13.053016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:13.053627 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:13.059869 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.060359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.061157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.061984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.226171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:13.252058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dd5efb90-a387-41ed-a1e6-27b4255a6cc0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.202575 Nov 09 10:38:13.264867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 283/558] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:13 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:13.665716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:13.666592 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:13.673697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.674764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.675590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.676217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.691864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:13.692942 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:13.702033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.702783 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.703945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:13.704591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:13.758143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6a078e93-2155-45e7-bfc0-a1ae0f4c2e13 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071254 Nov 09 10:38:13.762830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 284/559] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:13 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:38:13.860730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:13.869806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:13.872643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:13.873148 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-731b985f-8730-4ed9-8c06-c182a5dd5dd0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.211487 Nov 09 10:38:13.873708 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 276/560] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:13 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:14.285171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:14.285171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:14.304144 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:14.304899 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:14.306994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:14.307679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:14.567132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:14.577666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-16a37816-bfeb-4c4c-8816-65d21e8bca05 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.299462 Nov 09 10:38:14.586484 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 285/561] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:14 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:14.895312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:14.900359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:14.909671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:14.909671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:14.909671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:14.909671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.104517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:15.113896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:15.115842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:15.117384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-591fefd9-2cff-404f-af79-27fe0ca284a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.228150 Nov 09 10:38:15.118121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 277/562] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:14 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:15.154474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:15.154972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:15.161750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.162206 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.163040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.163474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.203889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:15.608774 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:15.609677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:15.618223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.618674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.619465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.619908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.684664 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5c99b0ed-a683-41e1-8a8a-7e85812460b1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 204 len: 0 microversion: 2.1 time: 0.533519 Nov 09 10:38:15.686319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 286/563] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:15 2021] DELETE /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:15.696425 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:15.697499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:15.720344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.723530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.723530 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:15.726141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:15.864733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:15.878625 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d995451e-1e73-493c-8b6f-8d5dbf2233b5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.276921 Nov 09 10:38:15.879631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 278/564] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:15 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:15.901488 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:15.907462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a9d1f38d-bef6-4816-926c-f8d3171e79f5 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1514 microversion: 2.1 time: 0.216734 Nov 09 10:38:15.908050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 287/565] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:15 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:16.140900 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:16.141515 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:16.148358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.148814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:16.149601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.150036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:16.295053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:16.303276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:16.304833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:16.305980 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cfcfc7f4-3b3e-4a75-ab47-26ffea122795 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.169534 Nov 09 10:38:16.306553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 279/566] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:16 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:16.904183 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:16.904183 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:16.927178 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.927178 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:16.927178 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.927178 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:16.927503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:16.927503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:16.932986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.933808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:16.934700 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:16.935424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:17.081097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:17.082819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:17.089220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e51ab9d1-e1e0-4531-817b-b1b4b024e635 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1514 microversion: 2.1 time: 0.167874 Nov 09 10:38:17.089777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 280/567] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:16 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:17.091258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-949ccbf1-173f-49f6-870e-a9bb2ba65096 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.198725 Nov 09 10:38:17.091832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 288/568] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:16 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:17.325118 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:17.325724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:17.332103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:17.332547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:17.333348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:17.333778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:17.469725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:17.470368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:17.483615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:17.484969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:17.486025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:17.487032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:17.500103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:17.509313 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:17.517864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:17.517864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-64d8b5c0-8223-4cf4-8598-9ae690ee03a0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.191129 Nov 09 10:38:17.517864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 281/569] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:17 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:17.604163 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'services' on Instance uuid a5924110-d06d-417d-9686-b288506a4155 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:17.996892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aaca20c0-d295-4f10-bce7-3a387952c7c0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155/os-volume_attachments/68e09d84-749c-4233-be15-719cfea9a3fd" status: 202 len: 0 microversion: 2.1 time: 0.530931 Nov 09 10:38:17.999686 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 289/570] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:38:17 2021] DELETE /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155/os-volume_attachments/68e09d84-749c-4233-be15-719cfea9a3fd => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:38:18.109570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:18.110239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:18.121299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:18.123447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.124052 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.125334 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.130428 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:18.140403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.141106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.142396 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.143417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.152641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.412438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:18.430314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-99d2667d-8d5b-4ab4-a1c1-4af60ce7e720 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1514 microversion: 2.1 time: 0.323032 Nov 09 10:38:18.433110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 282/571] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:18 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:18.505209 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:18.515832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6223a90a-c003-4643-8069-f9137a842b2b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.408443 Nov 09 10:38:18.517397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 290/572] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:18 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:18.536301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:18.539918 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:18.544457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.545111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.546084 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:18.546812 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:18.882064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:18.901928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:18.910673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:18.912869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5997489a-e9ac-47ca-a672-11a0fe6fbfc4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.380198 Nov 09 10:38:18.935434 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 283/573] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:18 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:19.093458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-dd54a80f-6d83-4061-a123-f53e494b863c req-83cef5bc-cd0c-46d5-b41c-df2501fb625d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495f1d34-e224-4dc2-a812-f8f1186558ab", "name": "network-vif-deleted", "tag": "be7f1284-1ab8-4d35-a9f8-08db1bc7a60e"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:19.096819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:19.096819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:19.121301 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-dd54a80f-6d83-4061-a123-f53e494b863c req-83cef5bc-cd0c-46d5-b41c-df2501fb625d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.121756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-dd54a80f-6d83-4061-a123-f53e494b863c req-83cef5bc-cd0c-46d5-b41c-df2501fb625d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.165929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-dd54a80f-6d83-4061-a123-f53e494b863c req-83cef5bc-cd0c-46d5-b41c-df2501fb625d service nova] Creating event network-vif-deleted:be7f1284-1ab8-4d35-a9f8-08db1bc7a60e for instance 495f1d34-e224-4dc2-a812-f8f1186558ab on hv-cinder-81662 Nov 09 10:38:19.189611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-dd54a80f-6d83-4061-a123-f53e494b863c req-83cef5bc-cd0c-46d5-b41c-df2501fb625d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112479 Nov 09 10:38:19.191342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 291/574] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:19.452069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:19.453659 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:19.461016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.461978 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.463110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.463544 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.535802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:19.536790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:19.547328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.547773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.548599 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.549044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.605302 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:19.619276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2cbedcd9-a792-46f7-a68f-7ec89580362e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1303 microversion: 2.1 time: 0.174193 Nov 09 10:38:19.621560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 284/575] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:19 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:19.810016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:19.819638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-46c4ea59-2266-4593-ae68-fb3a553808fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.288443 Nov 09 10:38:19.821130 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 292/576] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:19 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:19.944224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:19.944842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:19.954104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.958183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:19.959997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:19.961654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.343415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:20.353703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:20.360170 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:20.362788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b7bb92fd-87f7-41eb-b497-ec0543ffb488 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.423721 Nov 09 10:38:20.368379 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 285/577] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:19 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:20.426010 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:20.427786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:20.446638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.447571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.448717 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.449673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.501522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:20.639306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:20.640075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:20.649857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.650858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.651991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.652666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.757962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.757962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.757962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 495f1d34-e224-4dc2-a812-f8f1186558ab {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:20.835104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:20.844548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2cc311df-58c2-4238-877d-4928236011cc tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 200 len: 1308 microversion: 2.1 time: 0.209687 Nov 09 10:38:20.845140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 286/578] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:20 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:20.851364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:20.852235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:20.858458 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.859230 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.860242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.861070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.968277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3f2d086c-1412-4205-9a4a-2c00c9aa4bb6 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 204 len: 0 microversion: 2.1 time: 0.550170 Nov 09 10:38:20.969666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 293/579] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:20 2021] DELETE /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:20.982312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:20.983808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:20.992015 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.992471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:20.993263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:20.993972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:21.266548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:21.283896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4e53bec1-668e-4d9c-808e-14e37fa3aecd tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.431540 Nov 09 10:38:21.286569 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 287/580] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:20 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:21.327453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:21.337592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c8c1431d-b1d8-42a1-b280-5413c1650f4e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1514 microversion: 2.1 time: 0.363115 Nov 09 10:38:21.348810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 294/581] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:20 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:21.387266 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:21.387883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:21.396305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:21.397581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:21.398617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:21.399189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:21.581592 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:21.593056 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:21.595684 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:21.597327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a1ae051c-2ecd-42ee-9168-c94f5252ac59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.213371 Nov 09 10:38:21.605565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 288/582] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:21 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:21.861646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:21.862348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 495f1d34-e224-4dc2-a812-f8f1186558ab] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:21.868676 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:21.869140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:21.869907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:21.870339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:21.887630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Instance 495f1d34-e224-4dc2-a812-f8f1186558ab could not be found. Nov 09 10:38:21.888253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 404 to user: Instance 495f1d34-e224-4dc2-a812-f8f1186558ab could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:21.889088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fe2453b9-4d88-4c0c-bbaf-491fbb78a65f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab" status: 404 len: 111 microversion: 2.1 time: 0.031134 Nov 09 10:38:21.892822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 295/583] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:21 2021] GET /compute/v2.1/servers/495f1d34-e224-4dc2-a812-f8f1186558ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:38:22.306619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:22.307405 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:22.313438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.313904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:22.317311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.317311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:22.357745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:22.358628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:22.366667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.367382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:22.368487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.385594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:22.480522 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:22.501813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3b3b6766-bd87-4fc0-82d3-edd059c3964f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1569 microversion: 2.1 time: 0.198496 Nov 09 10:38:22.502824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 289/584] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:22 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:22.529338 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:22.543371 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f584c169-3efa-47f4-b820-a0cbe5524907 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1514 microversion: 2.1 time: 0.189776 Nov 09 10:38:22.543945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 296/585] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:22 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:22.623910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:22.623910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:22.623910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.623910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:22.624472 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:22.624472 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.064736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:23.086166 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:23.088293 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:23.089732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-27250bff-3d08-4b53-bca4-a45654cf5239 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.478076 Nov 09 10:38:23.090491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 290/586] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:22 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:23.519357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:23.520686 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:23.533345 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.534472 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.535620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.539038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.562308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:23.562916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:23.575281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.579314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.580413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.582243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.768236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:23.779260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d025e8dc-de1d-46e4-aeea-3f668d29a054 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1514 microversion: 2.1 time: 0.221569 Nov 09 10:38:23.781192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 291/587] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:23 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:23.786785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:23.788104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:23.798195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.798662 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.799486 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.799924 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.834532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:23.843347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-37afc268-9d67-4175-97c3-0490a945076e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1549 microversion: 2.1 time: 0.327936 Nov 09 10:38:23.843932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 297/588] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:23 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1549 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:23.884733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:23.890542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:23.891458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:23.906986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.907736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:23.908785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:23.910715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.431876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-619d4e1e-b6bd-411f-bedc-03ee8831631f tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 204 len: 0 microversion: 2.1 time: 0.648769 Nov 09 10:38:24.435843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 292/589] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:23 2021] DELETE /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:24.452372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:24.455921 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:24.461195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.462068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.464502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.465191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.540448 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] HTTP exception thrown: Cannot 'detach_volume' instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 while it is in vm_state rescued Nov 09 10:38:24.541780 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Returning 409 to user: Cannot 'detach_volume' instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 while it is in vm_state rescued {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:24.542900 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-57486a5b-fe16-4f7a-b736-1cd522a6b5ef tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments/f07675a0-4c77-4683-8f22-54c6dd1d449c" status: 409 len: 152 microversion: 2.1 time: 0.681187 Nov 09 10:38:24.547629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 298/590] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:38:23 2021] DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments/f07675a0-4c77-4683-8f22-54c6dd1d449c => generated 152 bytes in 684 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 09 10:38:24.550704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-2d903384-9ad0-43e7-88b7-c387814d974d req-a18960fd-58eb-4823-bdf9-95fb77986476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5924110-d06d-417d-9686-b288506a4155", "name": "network-vif-deleted", "tag": "57025d56-126d-4a16-a8f5-a8c2b1c1acc8"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:24.552608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:24.552608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:24.564696 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-2d903384-9ad0-43e7-88b7-c387814d974d req-a18960fd-58eb-4823-bdf9-95fb77986476 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.565151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-2d903384-9ad0-43e7-88b7-c387814d974d req-a18960fd-58eb-4823-bdf9-95fb77986476 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.578980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-2d903384-9ad0-43e7-88b7-c387814d974d req-a18960fd-58eb-4823-bdf9-95fb77986476 service nova] Creating event network-vif-deleted:57025d56-126d-4a16-a8f5-a8c2b1c1acc8 for instance a5924110-d06d-417d-9686-b288506a4155 on hv-cinder-81662 Nov 09 10:38:24.583944 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-2d903384-9ad0-43e7-88b7-c387814d974d req-a18960fd-58eb-4823-bdf9-95fb77986476 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038263 Nov 09 10:38:24.584661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 299/591] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:24.590950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:24.591665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:24.601963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.601963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.601963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.601963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.653135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:24.664628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:24.666847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:24.668383 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-45d729e3-4c25-4bf0-b934-c67ba3870d2a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.230963 Nov 09 10:38:24.669069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 293/592] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:24 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:24.674844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:24.675738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:24.687448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.690042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.692223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.692851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.818716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:24.827031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c708b2dd-0445-467a-aa76-251185101b80 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1513 microversion: 2.1 time: 0.241004 Nov 09 10:38:24.828044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 300/593] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:24 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:24.833290 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:24.834447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:24.840932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.841496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.842467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.842965 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.892472 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:24.893182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:24.894009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'fault' on Instance uuid a5924110-d06d-417d-9686-b288506a4155 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:24.946430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:24.961421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-693ad9db-5359-4b52-9ec6-a2b7b0812c2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1309 microversion: 2.1 time: 0.131739 Nov 09 10:38:24.963276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 301/594] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:24 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:24.986623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-87a27f26-5577-4c88-8a57-ab9fabba3a9e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action" status: 202 len: 0 microversion: 2.1 time: 0.315787 Nov 09 10:38:24.991390 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 294/595] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:38:24 2021] POST /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:38:25.000461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:25.002343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:25.013991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.015044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.022222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.022222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.468946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:25.477970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-67de951c-a7ca-48d4-949d-e663809eea6d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1557 microversion: 2.1 time: 0.485065 Nov 09 10:38:25.478555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 302/596] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:24 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1557 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:25.693325 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:25.694050 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:25.700833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.701323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.702238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.702678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.845463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:25.846066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:25.853389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.854133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.854929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.855358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.871147 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:25.880873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:25.882327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:25.883728 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c0a65a81-fd63-4c11-832f-ce2cf2acd3a3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.194959 Nov 09 10:38:25.884334 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 295/597] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:25 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:25.981127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:25.982146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:25.988515 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.989041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:25.989820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:25.990249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:26.005134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:26.012863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a3b5e5aa-7a45-45de-97b4-576802d172c3 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1513 microversion: 2.1 time: 0.171151 Nov 09 10:38:26.013447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 303/598] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:25 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:26.022570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:26.025493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:26.025493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'fault' on Instance uuid a5924110-d06d-417d-9686-b288506a4155 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:26.063123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:26.070754 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-67c8bc0b-687e-4864-a71b-254cb7ae2aaa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1309 microversion: 2.1 time: 0.095538 Nov 09 10:38:26.071290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 296/599] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:25 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:26.495822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:26.496526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:26.503429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:26.503876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:26.504706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:26.505141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:26.649060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:26.657687 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b83e390e-710c-4054-906b-00fdaffae710 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1557 microversion: 2.1 time: 0.165810 Nov 09 10:38:26.658586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 304/600] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:26 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:26.942988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:26.943531 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:26.952450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:26.952899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:26.953680 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:26.954113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.030258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:27.030864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:27.038245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.038691 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.039478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.039954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.085845 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.093907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.095416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.096619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7092fd27-3af5-4021-b58f-282fdffb602c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.157507 Nov 09 10:38:27.097183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 297/601] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:26 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:27.103834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:27.104529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:27.111443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.112007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.112800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.113282 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.145110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.145553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.145998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'fault' on Instance uuid a5924110-d06d-417d-9686-b288506a4155 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:27.174632 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.183047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b74ad525-a9d2-42ab-90f1-e94088492058 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1513 microversion: 2.1 time: 0.156842 Nov 09 10:38:27.183638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 305/602] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:27 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:27.195587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.203276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b9855d84-f863-444c-b5c6-fa1151accd17 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1309 microversion: 2.1 time: 0.105094 Nov 09 10:38:27.203846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 298/603] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:27 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:27.674180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:27.674773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:27.681118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.681580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.682398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:27.682829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:27.833444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:27.841809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-028a8045-7394-4f15-b7a0-dfa9adcc03c3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1557 microversion: 2.1 time: 0.171502 Nov 09 10:38:27.842371 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 306/604] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:27 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:28.101033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-16d2f913-b2fd-4d61-a12a-ce406b7ee60a req-0cb591d3-9ac6-440a-b1b5-e42f58f3bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "name": "network-vif-unplugged", "status": "completed", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:28.104527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:28.104527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:38:28.112036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-16d2f913-b2fd-4d61-a12a-ce406b7ee60a req-0cb591d3-9ac6-440a-b1b5-e42f58f3bb70 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.112834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-16d2f913-b2fd-4d61-a12a-ce406b7ee60a req-0cb591d3-9ac6-440a-b1b5-e42f58f3bb70 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.116626 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:28.117778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:28.124496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.124930 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.125049 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-16d2f913-b2fd-4d61-a12a-ce406b7ee60a req-0cb591d3-9ac6-440a-b1b5-e42f58f3bb70 service nova] Creating event network-vif-unplugged:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:38:28.125708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.126134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.130150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-16d2f913-b2fd-4d61-a12a-ce406b7ee60a req-0cb591d3-9ac6-440a-b1b5-e42f58f3bb70 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035101 Nov 09 10:38:28.130838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 299/605] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:28.200609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:28.201579 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:28.208854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.208989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.209704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.210129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.350561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:28.359197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:28.361697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:28.362946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-38a0b982-a543-4190-b3d3-ad0f57f93691 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1736 microversion: 2.20 time: 0.250567 Nov 09 10:38:28.363505 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 307/606] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:28 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:28.379989 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:28.380891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:28.387883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.388364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.389268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.390925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.397495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:28.408542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-15ed3298-bf44-4c4d-b4e2-1ac9f22d7b2c tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1513 microversion: 2.1 time: 0.211904 Nov 09 10:38:28.409882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 300/607] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:28 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:28.447091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.447682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.448287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'fault' on Instance uuid a5924110-d06d-417d-9686-b288506a4155 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:28.496750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:28.506051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-869e5f40-2acb-4836-8908-5913780247a7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 200 len: 1309 microversion: 2.1 time: 0.141386 Nov 09 10:38:28.507174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 308/608] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:28 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:28.858775 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:28.859493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:28.867448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.868807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:28.871427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:28.872653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.052972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:29.060784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6501ff2d-2032-4d13-b936-0aaf96f4855c tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1557 microversion: 2.1 time: 0.205688 Nov 09 10:38:29.061606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 301/609] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:28 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1557 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:29.382732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:29.383358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:29.389328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.389848 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.390675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.391171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.426099 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:29.426693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:29.433442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.433968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.434828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.435460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.563770 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:29.579036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:29.582291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:29.586086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f2a2b92f-35be-4dde-8069-46a7092af50c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1718 microversion: 2.20 time: 0.207541 Nov 09 10:38:29.587509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 309/610] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:29 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1718 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:29.598688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:29.600408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:29.601572 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: a5924110-d06d-417d-9686-b288506a4155] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:29.608446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-38d0e7ae-f6e6-4a8a-aa06-8561853645c2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1513 microversion: 2.1 time: 0.185829 Nov 09 10:38:29.608792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.609367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.618796 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 302/611] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:29 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:29.619006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:29.619006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:29.625879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] HTTP exception thrown: Instance a5924110-d06d-417d-9686-b288506a4155 could not be found. Nov 09 10:38:29.626828 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Returning 404 to user: Instance a5924110-d06d-417d-9686-b288506a4155 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:29.627589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7859cdd3-b945-4350-8158-81a21380732d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155" status: 404 len: 111 microversion: 2.1 time: 0.038203 Nov 09 10:38:29.628193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 310/612] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:29 2021] GET /compute/v2.1/servers/a5924110-d06d-417d-9686-b288506a4155 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:38:30.104925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:30.104925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:30.104925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.104925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.105850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.105850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.127354 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-aa83d9ca-aab3-4282-a072-cca0e12dceb8 req-1f826f51-b294-48c3-99b4-79a463f61a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "948f9420-0823-4643-bc32-21636281fc3a", "name": "network-vif-deleted", "tag": "a85ee1a5-296a-420d-a011-888db7794ba2"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:30.129286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:30.129286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:30.137002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-aa83d9ca-aab3-4282-a072-cca0e12dceb8 req-1f826f51-b294-48c3-99b4-79a463f61a8e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.146423 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-aa83d9ca-aab3-4282-a072-cca0e12dceb8 req-1f826f51-b294-48c3-99b4-79a463f61a8e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.160180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-aa83d9ca-aab3-4282-a072-cca0e12dceb8 req-1f826f51-b294-48c3-99b4-79a463f61a8e service nova] Creating event network-vif-deleted:a85ee1a5-296a-420d-a011-888db7794ba2 for instance 948f9420-0823-4643-bc32-21636281fc3a on hv-cinder-81662 Nov 09 10:38:30.169299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-aa83d9ca-aab3-4282-a072-cca0e12dceb8 req-1f826f51-b294-48c3-99b4-79a463f61a8e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045528 Nov 09 10:38:30.172291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 311/613] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:30.244229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:30.252611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f9f747b9-d246-43c0-ac13-a2c1733300b0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1557 microversion: 2.1 time: 0.178353 Nov 09 10:38:30.253195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 303/614] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:30 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:30.606002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:30.606707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:30.613305 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.613760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.614547 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.614983 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.629779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:30.630402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:30.637761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.638247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.638999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.639437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.681824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:30.682135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:30.682603 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:30.726490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:30.740270 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c0d521d8-b634-449f-806e-35b156eb6bae tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1307 microversion: 2.1 time: 0.117121 Nov 09 10:38:30.740786 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 304/615] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:30 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:30.778618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:30.786880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:30.788610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:30.789943 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-188bc0ce-6a22-4bc3-8f7d-ca973d67efc6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1718 microversion: 2.20 time: 0.188493 Nov 09 10:38:30.790498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 312/616] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:30 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1718 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:31.269508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:31.270103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:31.275893 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.276656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.277164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.277594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.414162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:31.422433 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e303197b-70bd-4488-9155-6812fe4874f5 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1563 microversion: 2.1 time: 0.156569 Nov 09 10:38:31.425758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 305/617] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:31 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:31.504948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:31.505447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:31.511239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.511695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.512497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.512935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.589406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'services' on Instance uuid 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:31.760953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:31.761563 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:31.767998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.768442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.769227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.769656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.800975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.801419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.801866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:31.843442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:31.852968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-52290f44-123d-4a41-a3ce-3b6d4a07f01d tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1307 microversion: 2.1 time: 0.095644 Nov 09 10:38:31.853856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 306/618] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:31 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:31.858760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:31.859507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:31.865975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.866638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.867425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.868053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.921060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3740a273-400b-4080-964c-135158a4480b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments/f07675a0-4c77-4683-8f22-54c6dd1d449c" status: 202 len: 0 microversion: 2.1 time: 0.419569 Nov 09 10:38:31.924970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 313/619] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:38:31 2021] DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments/f07675a0-4c77-4683-8f22-54c6dd1d449c => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:38:31.930329 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:31.931369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:31.937511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.937957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.938731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:31.939158 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:31.979360 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-776d3f5f-55a2-4ee3-918a-106f1aea1875 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053138 Nov 09 10:38:31.980083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 314/620] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:31 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:32.005799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:32.016798 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:32.018406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:32.019829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a6e48dbb-f72d-4344-b601-c51e46b0d150 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1718 microversion: 2.20 time: 0.164829 Nov 09 10:38:32.020447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 307/621] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:31 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:32.869984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:32.870589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:32.877278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:32.877721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:32.878492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:32.878925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:32.908391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:32.908839 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:32.909280 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:32.949679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:32.955646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-460585ad-a1d0-40c1-be58-65c892c36989 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1307 microversion: 2.1 time: 0.089935 Nov 09 10:38:32.956229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 315/622] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:32 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:32.991265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:32.992286 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:32.999520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:32.999995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.000777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.001211 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.033933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-00a3e9d4-5f25-41e8-b4f0-88fb00412397 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047107 Nov 09 10:38:33.034486 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 308/623] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:32 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:33.041538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:33.042142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:33.047933 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.048417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.049182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.049614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.177841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:33.186495 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:33.188007 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:33.189160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-59dd54f8-959a-4b02-a099-d81abcd67c45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1721 microversion: 2.20 time: 0.151830 Nov 09 10:38:33.189726 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 316/624] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:33 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:33.209786 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2476d71-ddcc-47e9-a1f5-ec619b7d5645"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:33.209786 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:33.214921 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.215365 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.216229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.216655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.972343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:33.973164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:33.979617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.980208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:33.980882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:33.981320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.016001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.016657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.017192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 948f9420-0823-4643-bc32-21636281fc3a {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:34.058053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:34.066116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dce6b10a-6028-4292-b20b-480acd4bd82e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 200 len: 1307 microversion: 2.1 time: 0.097365 Nov 09 10:38:34.066804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 317/625] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:33 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:34.071851 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:34.072843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:34.079997 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.080517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.081272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.081697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.125980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ef073ed4-6a60-4e00-8bf4-ecbd7d7712d3 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058046 Nov 09 10:38:34.126835 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 318/626] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:34 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:34.337476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2436f41a-97c7-4cb0-b7da-248509e49b8e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.134084 Nov 09 10:38:34.338399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 309/627] 10.222.0.35 () {62 vars in 1363 bytes} [Tue Nov 9 10:38:33 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments => generated 188 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:38:34.451408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:34.452014 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:34.458091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.458544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.459364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.459802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.866079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fcf8797c-59d9-46f2-a8f7-4c57a1a03e89 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action" status: 202 len: 0 microversion: 2.20 time: 0.418455 Nov 09 10:38:34.866794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 319/628] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:38:34 2021] POST /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:34.875182 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:34.875827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:34.882742 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.883177 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:34.884181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:34.884451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.084858 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:35.085555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 948f9420-0823-4643-bc32-21636281fc3a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:35.088140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:35.102249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.102811 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.103533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:35.103683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.104581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.105375 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:35.107175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-da44ab05-f4b4-4abb-ba06-a3ae7d3c4d3c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1747 microversion: 2.20 time: 0.235889 Nov 09 10:38:35.107756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 310/629] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:34 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1747 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:35.119542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Instance 948f9420-0823-4643-bc32-21636281fc3a could not be found. Nov 09 10:38:35.120194 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 404 to user: Instance 948f9420-0823-4643-bc32-21636281fc3a could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:35.121267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1d757730-102b-4b51-addf-5763671c1898 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a" status: 404 len: 111 microversion: 2.1 time: 0.040700 Nov 09 10:38:35.122169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 320/630] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:35 2021] GET /compute/v2.1/servers/948f9420-0823-4643-bc32-21636281fc3a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:38:35.130606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:35.131637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:35.141224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.141648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:35.143441 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.143641 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:35.145321 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.146124 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.150236 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.150790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.151641 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.152322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.184424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7d9893f3-26b1-48a5-9fdd-cdd7548704ea tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046631 Nov 09 10:38:35.185001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 321/631] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:38:35 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:38:35.194444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:35.796685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-855e64f4-41b1-44be-916a-58341b58a979 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 204 len: 0 microversion: 2.1 time: 0.668708 Nov 09 10:38:35.797690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 311/632] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:35 2021] DELETE /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:35.808517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:35.809112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:35.816164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.816699 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.817577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:35.818057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:35.985727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:36.000690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-143e6fdb-7f14-4d79-b118-23262d22fd43 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1515 microversion: 2.1 time: 0.191665 Nov 09 10:38:36.000690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 322/633] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:35 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:36.138654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:36.139352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:36.145455 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:36.146122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:36.147906 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:36.154682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:36.292220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:36.301200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:36.302721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:36.304491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-dde0033e-f705-47e6-8b1d-a4e336e5eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1747 microversion: 2.20 time: 0.169876 Nov 09 10:38:36.305052 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 312/634] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:36 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:37.011679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:37.012565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:37.019027 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:37.020318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:37.021372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:37.024955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:37.194213 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:37.202022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ea39f05c-310c-4bda-a5af-2c15e7de1b12 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1515 microversion: 2.1 time: 0.194444 Nov 09 10:38:37.202602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 323/635] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:37 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:37.325220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:37.326571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:37.334211 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:37.335723 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:37.336623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:37.337127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:37.516146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:37.525775 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:37.527451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:37.528677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1f21d23a-8c60-48a4-892d-ffcde87c6a08 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1749 microversion: 2.20 time: 0.207604 Nov 09 10:38:37.529437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 313/636] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:37 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:37.972055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-351e8354-c793-4cef-9eca-0bcae60ac673 req-3bd2fb84-ce65-45b8-a01d-572d5d289ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf9a9cd-5816-4665-bcc6-e2a754b943c0", "name": "network-vif-deleted", "tag": "f137f694-12be-40a2-af9b-d28f9b1b9082"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:37.974776 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:37.974776 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:37.982557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-351e8354-c793-4cef-9eca-0bcae60ac673 req-3bd2fb84-ce65-45b8-a01d-572d5d289ba2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:37.983192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-351e8354-c793-4cef-9eca-0bcae60ac673 req-3bd2fb84-ce65-45b8-a01d-572d5d289ba2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:37.995058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-351e8354-c793-4cef-9eca-0bcae60ac673 req-3bd2fb84-ce65-45b8-a01d-572d5d289ba2 service nova] Creating event network-vif-deleted:f137f694-12be-40a2-af9b-d28f9b1b9082 for instance daf9a9cd-5816-4665-bcc6-e2a754b943c0 on hv-cinder-81662 Nov 09 10:38:38.004810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-351e8354-c793-4cef-9eca-0bcae60ac673 req-3bd2fb84-ce65-45b8-a01d-572d5d289ba2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037774 Nov 09 10:38:38.005678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 324/637] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:38.219011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:38.219607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:38.225844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:38.226281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:38.227043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:38.227468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:38.292620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:38.300669 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9540d95e-5c53-4165-8c53-e1a24e5f5305 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1473 microversion: 2.1 time: 0.085274 Nov 09 10:38:38.307951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 314/638] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:38 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:38.548340 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:38.548957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:38.555225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:38.555682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:38.556700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:38.556978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:38.695801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:38.704326 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:38.705842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:38.707189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1eab992f-c5b1-4f26-abb1-8b2bba0729db tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1749 microversion: 2.20 time: 0.163481 Nov 09 10:38:38.708011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 325/639] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:38 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:39.318263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:39.320513 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:39.326580 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:39.327026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:39.327804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:39.328432 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:39.388772 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:39.396436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5b896ace-ddaa-4b2f-b981-38db16f631e2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1473 microversion: 2.1 time: 0.082524 Nov 09 10:38:39.397292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 315/640] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:39 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1473 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:39.726741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:39.727380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:39.733668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:39.734116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:39.734900 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:39.735323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:39.869876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:39.878982 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:39.880524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:39.882196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9032ac23-f790-4e1c-a0d9-d91f6f1d90c9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1749 microversion: 2.20 time: 0.159708 Nov 09 10:38:39.882857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 326/641] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:39 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:40.412873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:40.413485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:40.419288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:40.419729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:40.420538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:40.420976 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:40.492613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:40.500399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e7aae68c-ac76-4154-aa7f-54f626f7e324 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1303 microversion: 2.1 time: 0.091505 Nov 09 10:38:40.500995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 316/642] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:40 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:40.899914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:40.900594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:40.907136 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:40.907631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:40.908544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:40.908977 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.008555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:41.008555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:41.008555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.008555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.009274 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.009274 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.044704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:41.069707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:41.084334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:41.085826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:41.087159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-534c0d3a-d672-4572-b56e-b89ec8cc456c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1749 microversion: 2.20 time: 0.191095 Nov 09 10:38:41.096945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 327/643] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:40 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1749 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:41.102460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-173928656", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "networks": [{"uuid": "660cd402-50db-4db3-8bfe-9b76071b69c8"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:41.153287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] validate_networks() for [('660cd402-50db-4db3-8bfe-9b76071b69c8', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:38:41.558622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b6e317f1-fd17-4239-ab4d-8cb7816ca4fe tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "DELETE /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 204 len: 0 microversion: 2.1 time: 0.570152 Nov 09 10:38:41.562442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 317/644] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:40 2021] DELETE /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:41.564824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:41.565539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:41.581703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.584011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.586790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.587576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.589672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:38:41.590119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:38:41.590605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:38:41.591028 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:38:41.591445 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:38:41.610012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.610458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.611283 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.611722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.627917 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.628520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.629188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid daf9a9cd-5816-4665-bcc6-e2a754b943c0 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:41.636603 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Getting quotas for project 640b54f9b67c485a84c3d04294d65400. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:38:41.641491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Getting quotas for user 018de1115494407b913906aa29ec3316 and project 640b54f9b67c485a84c3d04294d65400. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:38:41.654700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:38:41.657381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:38:41.689637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:41.697399 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-13494999-635a-48e5-bad8-971b1fa0d9fd tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 200 len: 1308 microversion: 2.1 time: 0.136515 Nov 09 10:38:41.697982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 318/645] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:41 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:41.703159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:41.703770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:41.712143 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.712600 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.713561 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:41.714006 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:41.805165 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-377ceca7-f1e5-489b-9c93-2e7a8d1c7986 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706910 Nov 09 10:38:41.806069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 328/646] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:38:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:38:41.816362 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aa6e3152-5edc-4315-813e-411e88a3b2ea tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:41.822041 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aa6e3152-5edc-4315-813e-411e88a3b2ea tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:41.876924 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-aa6e3152-5edc-4315-813e-411e88a3b2ea tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:41.896559 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aa6e3152-5edc-4315-813e-411e88a3b2ea tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1218 microversion: 2.1 time: 0.084050 Nov 09 10:38:41.898951 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 329/647] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:41 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:42.107615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:42.109706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:42.119207 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:42.120231 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:42.121034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:42.121648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:42.144963 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:42.153782 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d4423fab-4456-4b9a-a43a-55b823518ba0 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1508 microversion: 2.1 time: 0.454101 Nov 09 10:38:42.164329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 319/648] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:41 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:42.273374 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:42.283023 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:42.284918 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:42.286756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-95ebf704-b640-440b-a3e8-6b32c85db23a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1749 microversion: 2.20 time: 0.183787 Nov 09 10:38:42.300122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 330/649] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:42 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:42.714716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:42.715314 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: daf9a9cd-5816-4665-bcc6-e2a754b943c0] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:42.721607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:42.722041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:42.722799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:42.735009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:42.736737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Instance daf9a9cd-5816-4665-bcc6-e2a754b943c0 could not be found. Nov 09 10:38:42.737356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 404 to user: Instance daf9a9cd-5816-4665-bcc6-e2a754b943c0 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:42.738174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3f3326fa-355f-446d-be97-a7f80ee30e9e tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0" status: 404 len: 111 microversion: 2.1 time: 0.027187 Nov 09 10:38:42.738714 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 320/650] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:42 2021] GET /compute/v2.1/servers/daf9a9cd-5816-4665-bcc6-e2a754b943c0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:38:42.915038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-349eb01e-5132-4c7d-bd2b-6cc9f64ad6d7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:42.915653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-349eb01e-5132-4c7d-bd2b-6cc9f64ad6d7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:43.009278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-349eb01e-5132-4c7d-bd2b-6cc9f64ad6d7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:43.020945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-349eb01e-5132-4c7d-bd2b-6cc9f64ad6d7 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1218 microversion: 2.1 time: 0.109020 Nov 09 10:38:43.032762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 331/651] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:42 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:43.170738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:43.171693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:43.178518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:43.179102 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:43.180066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:43.180630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:43.307156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:43.307766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:43.315034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:43.315554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:43.316491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:43.317049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:43.456078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:43.465856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-761ff77c-234b-4ce5-944e-b33bd1b7b94b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1508 microversion: 2.1 time: 0.298995 Nov 09 10:38:43.467582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 321/652] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:43 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:43.489181 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:43.498673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:43.500499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:43.501674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5c227965-0abf-4a2e-8c11-f8ec64d86996 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.198247 Nov 09 10:38:43.502752 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 332/653] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:43 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:44.039041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:44.040890 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:44.047412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.047862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.048701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.049113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.118828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:44.126419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4200e43f-1b50-4a66-a11d-45fd5f559dd1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1222 microversion: 2.1 time: 0.091780 Nov 09 10:38:44.126983 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 322/654] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:44 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:44.482509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:44.483275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:44.493760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.494466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.495449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.496180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.521840 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:44.522651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:44.531289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.535202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.536265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:44.536856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:44.702300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:44.715075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3630fccc-4473-4cc2-8073-784159872812 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1508 microversion: 2.1 time: 0.235525 Nov 09 10:38:44.716036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 333/655] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:44 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:44.785465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:44.795038 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:44.796695 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:44.797948 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-07596b4a-221c-4b90-add0-f4624a330252 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.280444 Nov 09 10:38:44.798576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 323/656] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:44 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:45.142845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:45.143619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:45.152055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.152509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.153308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.153744 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.220144 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:45.228412 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d9d885ca-ed42-4bc3-97f8-7aa378d4fe5f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1222 microversion: 2.1 time: 0.089434 Nov 09 10:38:45.229064 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 334/657] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:45 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:45.734256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:45.736257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:45.744333 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.745035 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.746298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.746782 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.818485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:45.820920 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:45.831637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.833606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.843909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:45.844734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:45.988529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:45.998582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e0ea4cbf-7193-4f3e-9591-ad10a7be1cdf tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1508 microversion: 2.1 time: 0.268071 Nov 09 10:38:46.009066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 324/658] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:45 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:46.145963 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:46.160893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:46.166535 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:46.176222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bd8fd3cb-d022-4189-b5e6-12c63d3fd328 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.355030 Nov 09 10:38:46.180552 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 335/659] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:45 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:46.254804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:46.257246 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:46.257800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:46.257922 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:46.264760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.265268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:46.266275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.266782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:46.268067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.269743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:46.270554 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.272449 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:46.313128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:46.446042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:46.459957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-eb768eba-5f63-4ec7-9c54-4bc8d644b695 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1270 microversion: 2.1 time: 0.217620 Nov 09 10:38:46.470272 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 325/660] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:46 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:46.918697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6bb6c550-7024-4a0a-9fb3-f1090c07ad95 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 204 len: 0 microversion: 2.1 time: 0.666075 Nov 09 10:38:46.920308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 336/661] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:46 2021] DELETE /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:46.930279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:46.931562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:46.943136 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.944620 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:46.946226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:46.948870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.028132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:47.029317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:47.044197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.044653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.045474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.045894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.329314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.356762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-be31baf9-a183-4b31-9bc8-fc3688419618 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1508 microversion: 2.1 time: 0.343973 Nov 09 10:38:47.357360 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 337/662] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:47 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:47.369730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:47.370264 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:47.386503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.391162 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.396263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.398146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.399647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.399785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5ed02f2a-c66e-4909-9021-01331a21d57b tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1512 microversion: 2.1 time: 0.475165 Nov 09 10:38:47.404658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 326/663] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:46 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:47.477483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:47.478228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:47.487852 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.489654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.491648 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.492510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:47.721449 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.731077 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-56dbfb3e-a7a5-4fc4-ad77-a5b27a875a6a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1276 microversion: 2.1 time: 0.257525 Nov 09 10:38:47.742112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 327/664] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:47 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:47.965870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.965870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.969353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:47.969353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e6a103d1-2d40-42f4-aaed-3c00a50ebe70 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.557801 Nov 09 10:38:47.969353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 338/665] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:47 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:47.974519 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-9e31237d-d4b8-4579-bb5a-2dca105753aa req-a6694752-e19f-4676-b6fd-b0a8288469ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08913c05-333d-4287-b2b0-135fd053ca64", "name": "network-vif-deleted", "tag": "2182bd85-9c95-41fc-b98c-a0f7b03dc613"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:47.977624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:47.977624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:38:47.991356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9e31237d-d4b8-4579-bb5a-2dca105753aa req-a6694752-e19f-4676-b6fd-b0a8288469ac service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:47.992206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9e31237d-d4b8-4579-bb5a-2dca105753aa req-a6694752-e19f-4676-b6fd-b0a8288469ac service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.008492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-9e31237d-d4b8-4579-bb5a-2dca105753aa req-a6694752-e19f-4676-b6fd-b0a8288469ac service nova] Creating event network-vif-deleted:2182bd85-9c95-41fc-b98c-a0f7b03dc613 for instance 08913c05-333d-4287-b2b0-135fd053ca64 on hv-cinder-81662 Nov 09 10:38:48.014356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-9e31237d-d4b8-4579-bb5a-2dca105753aa req-a6694752-e19f-4676-b6fd-b0a8288469ac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050083 Nov 09 10:38:48.015573 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 328/666] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:48.381739 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:48.383160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:48.404771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.406561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.407898 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.412550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.421483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:48.424547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:48.453318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.453799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.455816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.456878 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.597808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:48.609811 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f1fc7811-0831-4965-a2ce-3aa735e8e69e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1293 microversion: 2.1 time: 0.235654 Nov 09 10:38:48.629631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 339/667] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:48 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:48.756357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:48.757005 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:48.787889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.787889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:48.787889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:48.787889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.011916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.026175 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3cb7ffa2-18e9-4c5e-b5f6-bbdc3044c145 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1512 microversion: 2.1 time: 0.610620 Nov 09 10:38:49.033965 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 329/668] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:48 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:49.047444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:49.048348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:49.065630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:49.065630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.065630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:49.065630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.161185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.185653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d60c88e7-7fb7-4d9f-bffd-6a25f142edf1 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.440019 Nov 09 10:38:49.186249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 340/669] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:48 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:49.338459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.348440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.356534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.360516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c1999ca4-51a3-46d4-8406-e5d2ae5dcc14 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.322882 Nov 09 10:38:49.361014 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 330/670] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:49 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:49.633838 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:49.634544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:49.676039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:49.676597 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.677427 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:49.677927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.783389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:49.784341 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:49.785004 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'fault' on Instance uuid 08913c05-333d-4287-b2b0-135fd053ca64 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:49.884298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:49.888508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f51af8ec-49f1-4a0d-94fa-777a4a6dbfb2 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 200 len: 1312 microversion: 2.1 time: 0.259361 Nov 09 10:38:49.893712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 341/671] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:49 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:50.044996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:50.045704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:50.055753 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.056243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.066415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.071928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.214248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:50.215954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:50.238786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.242248 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.243276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.243801 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.479826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:38:50.479826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:38:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b (ip 10.222.0.35) !!! Nov 09 10:38:50.507381 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:50.517865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9eecb43c-913a-4f37-b2f7-f20ca6d3d32a tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1512 microversion: 2.1 time: 0.477416 Nov 09 10:38:50.518756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 331/672] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:50 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:50.526143 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:50.527199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:50.535186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.536133 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.538353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.539019 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.898959 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:50.916157 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:50.924602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:50.926270 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-13a89ea8-9548-4c6e-84d5-5764c549e44e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.406371 Nov 09 10:38:50.928215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 332/673] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:50 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:50.942890 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:50.948125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 08913c05-333d-4287-b2b0-135fd053ca64] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:50.967223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.968521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:50.974822 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:50.974822 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.008792 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] HTTP exception thrown: Instance 08913c05-333d-4287-b2b0-135fd053ca64 could not be found. Nov 09 10:38:51.011173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Returning 404 to user: Instance 08913c05-333d-4287-b2b0-135fd053ca64 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:51.012238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6c5c75c2-6219-47d2-950e-3d447a4a63ee tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64" status: 404 len: 111 microversion: 2.1 time: 0.082769 Nov 09 10:38:51.016937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 333/674] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:50 2021] GET /compute/v2.1/servers/08913c05-333d-4287-b2b0-135fd053ca64 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:38:51.030625 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:51.031514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:51.071363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.074054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.075738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.079466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.165394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:38:51.272288 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:51.283632 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0efb894b-d4f3-4edc-b4ca-c4b30f8dafa3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 1.084557 Nov 09 10:38:51.287480 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 342/675] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:50 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:51.374043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-8a6b196b-cb2d-4131-b9e3-598ad2645643 req-6b45fbe6-4590-4d50-a73d-10413574fcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4625928f-8448-4d86-b1e6-28b6c5ddac57", "name": "network-vif-deleted", "tag": "3efed32a-8fe2-427e-9ada-fdc0f5a9c188"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:51.377058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:51.377058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:51.397787 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8a6b196b-cb2d-4131-b9e3-598ad2645643 req-6b45fbe6-4590-4d50-a73d-10413574fcf1 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.398228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8a6b196b-cb2d-4131-b9e3-598ad2645643 req-6b45fbe6-4590-4d50-a73d-10413574fcf1 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.416043 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-8a6b196b-cb2d-4131-b9e3-598ad2645643 req-6b45fbe6-4590-4d50-a73d-10413574fcf1 service nova] Creating event network-vif-deleted:3efed32a-8fe2-427e-9ada-fdc0f5a9c188 for instance 4625928f-8448-4d86-b1e6-28b6c5ddac57 on hv-cinder-81662 Nov 09 10:38:51.422714 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-8a6b196b-cb2d-4131-b9e3-598ad2645643 req-6b45fbe6-4590-4d50-a73d-10413574fcf1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054609 Nov 09 10:38:51.423955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 343/676] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:38:51.479479 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-07ba9ef3-e2cf-48ad-acf8-b3cb4845f1cd req-e45374a3-a3fc-4682-9d32-1cdb7faf2452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3da8b9c-fc0f-4199-aaa2-b668a78be88b", "tag": "6fa822c3-beb1-4f0a-be68-a45ff676e4b8"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:38:51.485174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:38:51.485174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:38:51.499897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-07ba9ef3-e2cf-48ad-acf8-b3cb4845f1cd req-e45374a3-a3fc-4682-9d32-1cdb7faf2452 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.500786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-07ba9ef3-e2cf-48ad-acf8-b3cb4845f1cd req-e45374a3-a3fc-4682-9d32-1cdb7faf2452 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.514320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-07ba9ef3-e2cf-48ad-acf8-b3cb4845f1cd req-e45374a3-a3fc-4682-9d32-1cdb7faf2452 service nova] Creating event network-changed:6fa822c3-beb1-4f0a-be68-a45ff676e4b8 for instance d3da8b9c-fc0f-4199-aaa2-b668a78be88b on hv-cinder-81662 Nov 09 10:38:51.520745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-07ba9ef3-e2cf-48ad-acf8-b3cb4845f1cd req-e45374a3-a3fc-4682-9d32-1cdb7faf2452 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057201 Nov 09 10:38:51.523227 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 344/677] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:38:51.535424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:51.536302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:51.546008 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.546867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.548313 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.549160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.686235 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:51.717483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-41e3bc46-394c-4c95-b098-9343e4c2fdd2 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1470 microversion: 2.1 time: 0.186527 Nov 09 10:38:51.727889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 345/678] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:51 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:51.739278 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3eaa9ef3-4e87-4f8f-b115-133ccefd0cf9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 204 len: 0 microversion: 2.1 time: 0.714076 Nov 09 10:38:51.746554 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 334/679] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:38:51 2021] DELETE /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:38:51.753747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:51.755071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:51.772369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.773334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.774613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.775392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.946998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:51.947706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:51.966481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.967218 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:51.968226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:51.968825 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:52.010105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:52.018333 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d77df7cc-e59d-4b91-99fc-a16530fd1d65 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.272193 Nov 09 10:38:52.031409 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 346/680] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:51 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:52.333239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:52.348688 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:52.377152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:52.377152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:52.377152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:52.377152 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.079750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.106035 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.117634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.121364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-60397e83-ede6-4a34-8295-fb76b7af6158 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 1.178554 Nov 09 10:38:53.124270 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 335/681] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:51 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:38:53.129340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:53.132368 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:53.149593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:53.151580 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.153360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:53.156127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.198502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:53.286955 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.286955 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 4625928f-8448-4d86-b1e6-28b6c5ddac57 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:53.286955 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.288848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-260a1544-7951-4450-9b94-0a0624c19d74 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1306 microversion: 2.1 time: 0.137738 Nov 09 10:38:53.288848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 336/682] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:53 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1306 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:53.288848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:53.288848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:53.288848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:53.289738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.289738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:53.289738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:53.516605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.535853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6062f0d0-1a6f-4e03-a8c0-b60991e62d6e tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 1.230166 Nov 09 10:38:53.549312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 347/683] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:52 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:53.606133 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:53.619731 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3168c435-9e9e-4be7-aa7e-e11d1158ef9f tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.354336 Nov 09 10:38:53.636188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 337/684] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:53 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:54.146914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:54.148061 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:54.156293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.164763 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.164763 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.164763 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.297972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:54.298676 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:54.314006 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.314485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.316518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.317016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.409339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.409339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.409339 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lazy-loading 'fault' on Instance uuid 4625928f-8448-4d86-b1e6-28b6c5ddac57 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:38:54.475381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:54.485678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:54.498328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:54.500660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2227f932-f563-4baa-8db0-59ce29f4a93b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.357822 Nov 09 10:38:54.517755 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 348/685] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:54 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:54.561118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:54.563447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:54.585576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.597261 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a255547966e430bac7a2b4d0c0727b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4a5ce13d4496f8a0f0a50d852098e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:54.608505 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.611113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0df397ee-9843-4014-80b7-3c412681acc1 tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 200 len: 1306 microversion: 2.1 time: 0.317862 Nov 09 10:38:54.612372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.613090 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.620028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 338/686] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:54 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:54.646255 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:54.648250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:54.668576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.672996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:54.672996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:54.672996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:55.130986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:55.141671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cacc697a-0a34-4bc0-87ce-fe206d43d336 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.499866 Nov 09 10:38:55.142246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 339/687] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:54 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:38:55.217244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:55.224839 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f653dd4d-9ea4-4e60-80ba-a89add4bb200 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.671594 Nov 09 10:38:55.235250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 349/688] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:54 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:55.526143 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:55.526873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:55.541960 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:55.547317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:55.547317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:55.547317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:55.638161 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:55.640543 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] [instance: 4625928f-8448-4d86-b1e6-28b6c5ddac57] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:55.678753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:55.678753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:55.678753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:55.678753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:55.722068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] HTTP exception thrown: Instance 4625928f-8448-4d86-b1e6-28b6c5ddac57 could not be found. Nov 09 10:38:55.722688 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] Returning 404 to user: Instance 4625928f-8448-4d86-b1e6-28b6c5ddac57 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:38:55.723531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e3cb22ee-52ae-4011-954e-8fd6f11b7dec tempest-AttachVolumeNegativeTest-1362131915 tempest-AttachVolumeNegativeTest-1362131915-project] 10.222.0.35 "GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57" status: 404 len: 111 microversion: 2.1 time: 0.092079 Nov 09 10:38:55.748457 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 350/689] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:55 2021] GET /compute/v2.1/servers/4625928f-8448-4d86-b1e6-28b6c5ddac57 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:38:55.936091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:55.947370 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:55.952920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:55.959924 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-00b0fb3c-59d2-48ac-b1cf-d0909c872337 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.437952 Nov 09 10:38:55.961080 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 340/690] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:55 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:56.159316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:56.159949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:56.167426 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:56.212193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:56.212193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:56.212193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:56.246482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:56.248002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:56.262838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:56.263383 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:56.266570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:56.268531 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:56.578459 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:56.597001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-16d039d6-d433-4b09-bfbb-6a6a740f4ccc tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.438448 Nov 09 10:38:56.598279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 351/691] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:56 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:56.730181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:56.749033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ba33c50e-c31c-4998-9555-7b1442b0ed48 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.508436 Nov 09 10:38:56.764964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 341/692] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:56 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:56.982870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:56.984194 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:56.991202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:57.016243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:57.017106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:57.017541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:57.614999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:57.616366 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:57.628193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:57.628658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:57.629448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:57.629877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:58.131479 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:58.153613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7aea5cb4-d8b1-4c61-bd5e-5380dbe691a9 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.541347 Nov 09 10:38:58.161369 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 342/693] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:57 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:58.171778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:58.172529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:58.210478 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:58.210856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:58.212837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:58.213289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:58.296582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:58.319347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:58.331014 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:58.334135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6788a324-80be-4210-a290-e35297c749a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 1.352693 Nov 09 10:38:58.345727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 352/694] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:56 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:38:58.994691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:59.003333 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0f08f8bd-082d-4920-ab15-b572af70dd02 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.839683 Nov 09 10:38:59.011788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 343/695] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:58 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:38:59.171321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:59.172256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:59.185880 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:59.189737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:59.193003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:59.194148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:59.352641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:38:59.354116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:38:59.362046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:59.377847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:59.379473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:38:59.380183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:38:59.564725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:38:59.574468 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-de2bae53-7863-4036-8344-2271430ccc34 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.407605 Nov 09 10:38:59.600624 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 353/696] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:38:59 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:00.040066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:00.040066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:00.040066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:00.040066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:00.041222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:00.041222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:00.327916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:00.342361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:00.349326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:00.352002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-370114ae-2ecc-4f16-8abf-a382a6f15d2e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 1.003665 Nov 09 10:39:00.370074 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 344/697] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:38:59 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:00.577888 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:00.589276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d51522f7-4364-44e0-868a-96f38ab84dbf tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.572086 Nov 09 10:39:00.590697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 354/698] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:00 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:00.606916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:00.607097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:00.618256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:00.618256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:00.619121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:00.619628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:01.082482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:01.092152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2f4d40b9-0359-42ba-8d83-b15dddde78e6 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.489156 Nov 09 10:39:01.102090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 345/699] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:00 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:01.375251 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:01.376176 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:01.407141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:01.409151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:01.410047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:01.410529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:01.607960 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:01.609485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:01.636981 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:01.645151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:01.647062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:01.652452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:01.924056 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:01.947525 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:01.953316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:01.954797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-acc27d43-73de-4785-8e8b-5575f9b37f19 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.584352 Nov 09 10:39:01.958757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 355/700] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:01 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:02.110494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:02.111365 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:02.122494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:02.124570 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:02.125761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:02.128985 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:02.176804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:02.187287 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-729ff46a-53eb-4934-978e-ae677303e0f0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.584446 Nov 09 10:39:02.190401 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 346/701] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:01 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:02.373356 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:02.382639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6f89654d-5f23-4168-b2be-6fbc9bd4a17b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.276757 Nov 09 10:39:02.386273 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 356/702] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:02 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:02.976102 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:02.976721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:02.987560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:02.988054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:02.991992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:02.995719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:03.208451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:03.211549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:03.248953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:03.250386 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:03.257357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:03.259943 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:03.303935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:03.322326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:03.326887 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:03.333653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1a06ca73-02a6-418f-8f47-716f67a7eb86 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.362061 Nov 09 10:39:03.336296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 347/703] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:02 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:03.402603 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:03.403231 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:03.413114 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:03.414499 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:03.414499 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:03.416969 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:03.588276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:03.592025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c1898887-7553-4ed1-8c3f-b856d4bae5df tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.389772 Nov 09 10:39:03.593199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 357/704] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:03 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:03.874902 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:03.888408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-88d70ca6-fa10-46f0-a0df-dc59e353a1fa tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.489078 Nov 09 10:39:03.889048 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 348/705] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:03 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:04.361492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:04.363455 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:04.381408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.383256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:04.384339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.384931 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:04.612690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:04.613302 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:04.631373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.632651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:04.633705 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.634372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:04.721753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:04.733381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:04.739781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:04.743914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-beef1b7d-4829-4ab4-a127-398b54fa23a5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.387044 Nov 09 10:39:04.748687 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 358/706] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:04 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:04.904502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:04.905548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:04.912052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.920614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:04.921858 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:04.924704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:05.226710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:05.239356 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-eb6b62fa-cd9f-467a-8e5a-3b4b86dc9b4b tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.338488 Nov 09 10:39:05.254736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 359/707] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:04 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:05.260024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d5fb761b-91f4-4c8b-92d8-ef24b7c6e024 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd057700>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:05.298028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:05.324277 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a86000e8-f6d4-4d39-be3b-b1863897b89a tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.711669 Nov 09 10:39:05.329905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 349/708] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:04 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:05.389860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d5fb761b-91f4-4c8b-92d8-ef24b7c6e024 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/805125a8-4ce4-4114-8508-311c177cd8cb" status: 200 len: 351 microversion: 2.1 time: 0.133460 Nov 09 10:39:05.391161 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 360/709] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:39:05 2021] GET /compute/v2.1/os-volumes/805125a8-4ce4-4114-8508-311c177cd8cb => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:05.769824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:05.771347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:05.784612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:05.786709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:05.788710 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:05.789311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.187746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:06.206018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:06.209797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:06.209797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-15684491-d432-426d-82c5-f60927edfbe5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.446449 Nov 09 10:39:06.234297 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 350/710] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:05 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:06.261960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:06.262209 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:06.269300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:06.269760 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.270540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:06.280761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.366925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:06.366925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:06.380643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:06.381300 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.382187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:06.382665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.729068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:06.738060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-26a33989-f7c0-49ba-85e3-4c74e85aff3e tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1523 microversion: 2.1 time: 0.480028 Nov 09 10:39:06.750400 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 361/711] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:06 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:06.770452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-bbd130fd-e3a3-4a7b-8606-368eb30d337a req-7d395aa3-53fc-4e0c-be32-7ab70d05da33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a60a22-2f2e-4979-b8e2-b12a2e7bf671", "name": "network-vif-deleted", "tag": "2bbca5fa-0081-4df3-bbdb-1ebc76058527"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:06.774832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:06.774832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:39:06.801445 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-bbd130fd-e3a3-4a7b-8606-368eb30d337a req-7d395aa3-53fc-4e0c-be32-7ab70d05da33 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:06.801885 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-bbd130fd-e3a3-4a7b-8606-368eb30d337a req-7d395aa3-53fc-4e0c-be32-7ab70d05da33 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:06.841359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-bbd130fd-e3a3-4a7b-8606-368eb30d337a req-7d395aa3-53fc-4e0c-be32-7ab70d05da33 service nova] Creating event network-vif-deleted:2bbca5fa-0081-4df3-bbdb-1ebc76058527 for instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 on hv-cinder-81662 Nov 09 10:39:06.854182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-bbd130fd-e3a3-4a7b-8606-368eb30d337a req-7d395aa3-53fc-4e0c-be32-7ab70d05da33 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088082 Nov 09 10:39:06.855550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 362/712] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:06.910067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:06.983086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1773c8d1-9d27-4537-a5e4-068a8ded41b0 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.619590 Nov 09 10:39:06.983716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 351/713] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:06 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:07.241402 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:07.242372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:07.252173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.252970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.259179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.259887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.373933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-2bf8375e-bfd1-47e3-ac90-bdddcece9c37 req-274ec1d3-8146-4ff0-8478-ffddaa686a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da8b9c-fc0f-4199-aaa2-b668a78be88b", "name": "network-vif-plugged", "status": "completed", "tag": "6fa822c3-beb1-4f0a-be68-a45ff676e4b8"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:07.378194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:07.378194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:39:07.399915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-2bf8375e-bfd1-47e3-ac90-bdddcece9c37 req-274ec1d3-8146-4ff0-8478-ffddaa686a1d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.404945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-2bf8375e-bfd1-47e3-ac90-bdddcece9c37 req-274ec1d3-8146-4ff0-8478-ffddaa686a1d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.449195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-2bf8375e-bfd1-47e3-ac90-bdddcece9c37 req-274ec1d3-8146-4ff0-8478-ffddaa686a1d service nova] Creating event network-vif-plugged:6fa822c3-beb1-4f0a-be68-a45ff676e4b8 for instance d3da8b9c-fc0f-4199-aaa2-b668a78be88b on hv-cinder-81662 Nov 09 10:39:07.463884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-2bf8375e-bfd1-47e3-ac90-bdddcece9c37 req-274ec1d3-8146-4ff0-8478-ffddaa686a1d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092480 Nov 09 10:39:07.465191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 352/714] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:07.658781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:07.685818 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:07.695197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:07.696806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-626f062f-2cb2-4e41-b983-c3a3c0e09125 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.460474 Nov 09 10:39:07.697876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 363/715] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:07 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:07.755713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:07.756844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:07.772491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.778574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.779868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.780649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.856257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:07.859109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:07.860144 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lazy-loading 'fault' on Instance uuid 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:39:07.930938 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1615a1a5-3fc5-4f11-ae8e-3ec9b1a1a90a tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dcf4ca60>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:07.968723 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60785dfae7854bcea54ebd88af4dd93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2f00c4c004c6b91287e418c91d927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:07.977188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f4cddc44-ae13-4869-9a78-496beb7e35e7 tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 200 len: 1312 microversion: 2.1 time: 0.226199 Nov 09 10:39:07.981193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 353/716] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:07 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:08.009987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:08.010995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:08.019133 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:08.019835 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:08.020868 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:08.021917 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:08.108506 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1615a1a5-3fc5-4f11-ae8e-3ec9b1a1a90a tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/547c19c4-601d-42c4-b4b0-3081ed25f1e1" status: 200 len: 351 microversion: 2.1 time: 0.197759 Nov 09 10:39:08.112385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 364/717] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:39:07 2021] GET /compute/v2.1/os-volumes/547c19c4-601d-42c4-b4b0-3081ed25f1e1 => generated 351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:08.532437 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:08.534846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-39dd8c07-2c7d-4b49-a69b-2d349443fc2d tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.533431 Nov 09 10:39:08.535615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 354/718] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:08 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:08.716608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:08.717221 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:08.726579 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:08.727023 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:08.728053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:08.728486 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:08.944292 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:08.954114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:08.957394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:08.960179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dba152c2-6b41-4f91-a699-fd2e8808b2c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.247968 Nov 09 10:39:08.971758 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 365/719] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:08 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:08.998112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:08.998969 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] [instance: 63a60a22-2f2e-4979-b8e2-b12a2e7bf671] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:09.010015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.011832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:09.013311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.024847 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:09.065754 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] HTTP exception thrown: Instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 could not be found. Nov 09 10:39:09.066393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] Returning 404 to user: Instance 63a60a22-2f2e-4979-b8e2-b12a2e7bf671 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:09.067363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-578cb2bb-78f2-41a6-a47e-22deec3ec56d tempest-ServerRescueNegativeTestJSON-1525366166 tempest-ServerRescueNegativeTestJSON-1525366166-project] 10.222.0.35 "GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671" status: 404 len: 111 microversion: 2.1 time: 0.073554 Nov 09 10:39:09.069043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 355/720] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:08 2021] GET /compute/v2.1/servers/63a60a22-2f2e-4979-b8e2-b12a2e7bf671 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:39:09.555126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:09.560640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:09.570475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.575155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:09.575155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.575155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:09.982498 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:09.983118 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:09.992334 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.993061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:09.994047 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:09.994639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:10.040542 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:10.048246 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-14310af4-b8a5-414b-bc04-2eded145dcef tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1318 microversion: 2.1 time: 0.499725 Nov 09 10:39:10.048827 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 366/721] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:09 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:10.230645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:10.242933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:10.247120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:10.247120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-264924c2-32aa-42d9-b699-fdd3d77699e5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.267652 Nov 09 10:39:10.248160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 356/722] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:09 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:10.597065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-35ffb6b8-3984-4c28-ad86-2c604da1d253 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53ddaf3ca0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:10.696553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-35ffb6b8-3984-4c28-ad86-2c604da1d253 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/12459ccd-4b40-4a98-92c7-e95251b2f5ff" status: 200 len: 351 microversion: 2.1 time: 0.087897 Nov 09 10:39:10.696553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 367/723] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:39:10 2021] GET /compute/v2.1/os-volumes/12459ccd-4b40-4a98-92c7-e95251b2f5ff => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:10.730398 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e72e7120-7a37-4ead-88c6-c0115ecd1197 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd787430>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:10.817788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e72e7120-7a37-4ead-88c6-c0115ecd1197 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.094464 Nov 09 10:39:10.818608 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 357/724] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Nov 9 10:39:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:10.830908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f8484b4f-8707-4702-ba52-93f175e1024b tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53ddaac5e0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:10.924016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f8484b4f-8707-4702-ba52-93f175e1024b tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096765 Nov 09 10:39:10.924993 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 368/725] 10.222.0.35 () {58 vars in 1148 bytes} [Tue Nov 9 10:39:10 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:10.940440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f95ae4d0-52b8-4f6b-be81-73fd9e64a17b tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd73d9d0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.023062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f95ae4d0-52b8-4f6b-be81-73fd9e64a17b tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087653 Nov 09 10:39:11.024784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 358/726] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Nov 9 10:39:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:11.035503 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2cd0c1cc-5bc1-4b84-b54e-99dc8b60289a tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dcfac8b0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.065010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.065619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:11.090492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.090941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.091761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.092269 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.183350 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2cd0c1cc-5bc1-4b84-b54e-99dc8b60289a tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151515 Nov 09 10:39:11.185444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 369/727] 10.222.0.35 () {58 vars in 1166 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:11.202979 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8792dd39-b691-4dee-8205-d03d89c4e98d tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd14df70>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.286259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:11.299738 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ae8900d7-4bf4-446a-b7ac-700442d497aa tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1508 microversion: 2.1 time: 0.238475 Nov 09 10:39:11.300864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 359/728] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:11.306251 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.307190 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:11.314329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.315120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.316335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.317072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.334650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8792dd39-b691-4dee-8205-d03d89c4e98d tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.136383 Nov 09 10:39:11.335998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 370/729] 10.222.0.35 () {58 vars in 1169 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:11.341360 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c7cb2cd-0583-4980-814b-539953ca2e39", "device": "/dev/sdb"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:11.343562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:11.350767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.351306 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.352381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:11.352897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:11.786697 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:11.800146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:11.802183 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:11.804214 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1aa4605e-3edc-47a9-b351-41c0c6edd2f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.502202 Nov 09 10:39:11.804783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 360/730] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:11.826482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5fe4d04c-b83c-4d7f-8147-db36029dd189 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53de3bbc10>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:11.965751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5fe4d04c-b83c-4d7f-8147-db36029dd189 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.157930 Nov 09 10:39:11.967044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 361/731] 10.222.0.35 () {58 vars in 1154 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:11.978745 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-50cfc35f-eb98-43bc-b62f-e23fad8b8bb1 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd7874c0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:12.181760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-50cfc35f-eb98-43bc-b62f-e23fad8b8bb1 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.207451 Nov 09 10:39:12.183263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 362/732] 10.222.0.35 () {58 vars in 1187 bytes} [Tue Nov 9 10:39:11 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:12.198411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-98e46b64-d137-4c2d-bc62-b4e7bc55d514 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] Calling method '.version_select at 0x7f53dd75fc10>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:12.392119 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-98e46b64-d137-4c2d-bc62-b4e7bc55d514 tempest-VolumesTestJSON-2049521765 tempest-VolumesTestJSON-2049521765-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.199461 Nov 09 10:39:12.393757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 363/733] 10.222.0.35 () {58 vars in 1154 bytes} [Tue Nov 9 10:39:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:12.560359 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-24d83163-2da2-49db-a289-33a2e0a5e704 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "POST /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.222806 Nov 09 10:39:12.561040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 371/734] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:39:11 2021] POST /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b/os-volume_attachments => generated 194 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:12.823245 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:12.823856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:12.846930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:12.847374 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:12.855101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:12.855101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:13.311867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:13.324434 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:13.329832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:13.336053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-51710ed0-a746-4109-8023-6f5bf05b0f25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.512067 Nov 09 10:39:13.336053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 364/735] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:12 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:14.361102 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:14.374355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:14.413254 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:14.415703 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:14.419011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:14.421810 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:14.963367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-7002a077-f407-4a16-bb04-0f4726fc70e9 req-34064028-6647-4c4e-b4ad-5980ebebf3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "name": "network-vif-plugged", "status": "completed", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:14.964997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:14.964997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:39:14.998316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7002a077-f407-4a16-bb04-0f4726fc70e9 req-34064028-6647-4c4e-b4ad-5980ebebf3b5 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:14.998755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7002a077-f407-4a16-bb04-0f4726fc70e9 req-34064028-6647-4c4e-b4ad-5980ebebf3b5 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:15.035790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-7002a077-f407-4a16-bb04-0f4726fc70e9 req-34064028-6647-4c4e-b4ad-5980ebebf3b5 service nova] Creating event network-vif-plugged:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:39:15.042447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-7002a077-f407-4a16-bb04-0f4726fc70e9 req-34064028-6647-4c4e-b4ad-5980ebebf3b5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083408 Nov 09 10:39:15.050310 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 365/736] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:15.951326 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:15.966589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:15.970990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:15.977254 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-49ef74dd-d432-419b-abb1-f1efdaa48269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 1.623580 Nov 09 10:39:15.987682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 372/737] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:14 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:16.996940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:16.997718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:17.011986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:17.013257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:17.015908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:17.018948 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:17.532975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:17.553450 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:17.563335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:17.572714 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bd374acd-bef3-45c9-9574-83595576c1e3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.581003 Nov 09 10:39:17.575789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 366/738] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:16 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:18.601419 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:18.603363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:18.647233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:18.652275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:18.654147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:18.656373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:19.238812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:19.248484 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:19.250021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:19.251286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fd6f5157-9ff8-4adb-aa45-95efc20b8bd6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.664034 Nov 09 10:39:19.251955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 373/739] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:18 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:20.270961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:20.272833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:20.279535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:20.280015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:20.280816 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:20.281260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:20.438532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:20.448535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:20.450673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:20.451883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b285e272-11e4-45b6-be7a-7d40224377f9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1805 microversion: 2.20 time: 0.184729 Nov 09 10:39:20.463671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 367/740] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:20 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1805 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:39:21.410605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Action: 'create', calling method: .version_select at 0x7f53dcf68550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1411780037"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:21.446950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for project 06af7c886c064b628757c347296afd9f. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:21.452097 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for user 6a77eac8a3514e57b3cfea42325759dc and project 06af7c886c064b628757c347296afd9f. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:21.470836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:21.471561 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:21.486393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:21.487095 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:21.489098 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:21.489725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:21.717701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:21.728290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:21.730242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:21.731650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b910bb4d-c983-41b8-8da6-5948f642dd0b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1792 microversion: 2.20 time: 0.264997 Nov 09 10:39:21.733125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 368/741] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:39:21 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1792 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:39:22.773299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for project 06af7c886c064b628757c347296afd9f. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:22.780775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for user 6a77eac8a3514e57b3cfea42325759dc and project 06af7c886c064b628757c347296afd9f. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:22.820470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3b453951-3bae-406d-94e0-48359b359abc tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 2.161578 Nov 09 10:39:22.821322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 374/742] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Nov 9 10:39:20 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:23.501546 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cb9bd8ac-eb70-4b10-a2af-5796cdb5c8d5 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Action: 'create', calling method: .version_select at 0x7f53dd7581f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1645354641", "metadata": {"Type": "work"}}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:23.503324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cb9bd8ac-eb70-4b10-a2af-5796cdb5c8d5 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.504187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cb9bd8ac-eb70-4b10-a2af-5796cdb5c8d5 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.565846 Nov 09 10:39:23.504899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 369/743] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Nov 9 10:39:22 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 567 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:39:23.516378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a81c3cff-4405-48d4-97ee-3073eb853c1c tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Action: 'create', calling method: .version_select at 0x7f53dcf7eaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1601604092", "metadata": {"Type": "work"}}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:23.518324 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a81c3cff-4405-48d4-97ee-3073eb853c1c tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.519328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a81c3cff-4405-48d4-97ee-3073eb853c1c tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006981 Nov 09 10:39:23.520434 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 375/744] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Nov 9 10:39:23 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:39:23.529095 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-89c93d1f-10ac-4bf4-8889-f11623d60e2d tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Action: 'create', calling method: .version_select at 0x7f53dd951670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1898193065", "metadata": {"Type": "work"}}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:23.530530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-89c93d1f-10ac-4bf4-8889-f11623d60e2d tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.532086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-89c93d1f-10ac-4bf4-8889-f11623d60e2d tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006117 Nov 09 10:39:23.532992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 370/745] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Nov 9 10:39:23 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:39:23.542555 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f21a54f6-5b23-4fea-b24f-794ff7204df0 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Calling method '.version_select at 0x7f53ddaa0ca0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:23.587222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-f21a54f6-5b23-4fea-b24f-794ff7204df0 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] HTTP exception thrown: Volume tempest-invalid-1365325214 could not be found. Nov 09 10:39:23.587830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f21a54f6-5b23-4fea-b24f-794ff7204df0 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 404 to user: Volume tempest-invalid-1365325214 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.588706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f21a54f6-5b23-4fea-b24f-794ff7204df0 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1365325214" status: 404 len: 99 microversion: 2.1 time: 0.050944 Nov 09 10:39:23.593287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 376/746] 10.222.0.35 () {58 vars in 1217 bytes} [Tue Nov 9 10:39:23 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1365325214 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 09 10:39:23.600740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bd8a82a2-de87-4066-bdd8-d3afe83288af tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005613 Nov 09 10:39:23.602415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 371/747] 10.222.0.35 () {58 vars in 1139 bytes} [Tue Nov 9 10:39:23 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 10:39:23.616449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-283b5ee2-4020-4ef8-b3a4-e9a22d22dfe5 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003980 Nov 09 10:39:23.620669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 377/748] 10.222.0.35 () {58 vars in 1136 bytes} [Tue Nov 9 10:39:23 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 09 10:39:23.626195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5e758c4c-8da8-492e-b126-0c280c865cfb tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Calling method '.version_select at 0x7f53dd904700>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:23.660292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-5e758c4c-8da8-492e-b126-0c280c865cfb tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] HTTP exception thrown: Volume 6eb2880d-8819-4b3d-b3a9-a6ab9bca0b64 could not be found. Nov 09 10:39:23.660888 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5e758c4c-8da8-492e-b126-0c280c865cfb tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 404 to user: Volume 6eb2880d-8819-4b3d-b3a9-a6ab9bca0b64 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.663150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5e758c4c-8da8-492e-b126-0c280c865cfb tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/6eb2880d-8819-4b3d-b3a9-a6ab9bca0b64" status: 404 len: 109 microversion: 2.1 time: 0.039408 Nov 09 10:39:23.668116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 372/749] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:39:23 2021] DELETE /compute/v2.1/os-volumes/6eb2880d-8819-4b3d-b3a9-a6ab9bca0b64 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:39:23.674718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9f354b95-030a-4089-9be8-360b54361397 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Calling method '.version_select at 0x7f53dcf7ef70>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:23.730935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-9f354b95-030a-4089-9be8-360b54361397 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] HTTP exception thrown: Volume 19f0c085-70a8-4d5d-8487-da214edd2ec5 could not be found. Nov 09 10:39:23.732045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9f354b95-030a-4089-9be8-360b54361397 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] Returning 404 to user: Volume 19f0c085-70a8-4d5d-8487-da214edd2ec5 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:23.733519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9f354b95-030a-4089-9be8-360b54361397 tempest-VolumesNegativeTest-581729131 tempest-VolumesNegativeTest-581729131-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/19f0c085-70a8-4d5d-8487-da214edd2ec5" status: 404 len: 109 microversion: 2.1 time: 0.064121 Nov 09 10:39:23.734347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 378/750] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Nov 9 10:39:23 2021] GET /compute/v2.1/os-volumes/19f0c085-70a8-4d5d-8487-da214edd2ec5 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:39:28.081498 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'create', calling method: .version_select at 0x7f53dd73d040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1815529164"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:28.103406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for project b538f1548c3549a188cafef15f81b59c. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:28.107516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for user bd1a18d51c574a4e87e9126d8be327ce and project b538f1548c3549a188cafef15f81b59c. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:28.399625 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for project b538f1548c3549a188cafef15f81b59c. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:28.403374 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for user bd1a18d51c574a4e87e9126d8be327ce and project b538f1548c3549a188cafef15f81b59c. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:28.417215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b734cf0e-a936-44ba-acab-0a4bd8c9261e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.340049 Nov 09 10:39:28.427908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 373/751] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Nov 9 10:39:28 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:28.538934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1502030510", "imageRef": "06f8cdf0-365e-4b01-9d5d-ddf4babe5627", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1815529164", "networks": [{"uuid": "56f69718-58a6-4143-a9fa-e85c00997496"}]}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:28.597718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] validate_networks() for [('56f69718-58a6-4143-a9fa-e85c00997496', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:39:29.106830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:39:29.107477 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:39:29.108151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:39:29.108577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:39:29.108969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:39:29.118765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:29.119260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:29.120087 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:29.120550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:29.139087 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for project b538f1548c3549a188cafef15f81b59c. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:29.144224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Getting quotas for user bd1a18d51c574a4e87e9126d8be327ce and project b538f1548c3549a188cafef15f81b59c. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:29.157628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:39:29.159984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06f8cdf0-365e-4b01-9d5d-ddf4babe5627',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:39:29.299160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4441074d-a35f-47e7-bb43-4b9fffc87d48 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764923 Nov 09 10:39:29.299861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 379/752] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:39:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:39:29.310154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5c04d7b8-cad2-4d10-a59e-60a397104af9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:29.310770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5c04d7b8-cad2-4d10-a59e-60a397104af9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:29.368254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5c04d7b8-cad2-4d10-a59e-60a397104af9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:29.377173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5c04d7b8-cad2-4d10-a59e-60a397104af9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1259 microversion: 2.1 time: 0.071110 Nov 09 10:39:29.387483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 374/753] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:29 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:30.395372 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d4e43a19-a2c2-4518-b52e-21ad64372e1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:30.397884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d4e43a19-a2c2-4518-b52e-21ad64372e1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:30.451078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d4e43a19-a2c2-4518-b52e-21ad64372e1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:30.457790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d4e43a19-a2c2-4518-b52e-21ad64372e1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1259 microversion: 2.1 time: 0.066586 Nov 09 10:39:30.458886 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 380/754] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:30 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:31.475988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:31.478126 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:31.492821 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:31.493278 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:31.494070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:31.494509 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:31.561758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:31.577782 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d9b32dfc-4a5b-453a-afdc-fda7688d8392 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1255 microversion: 2.1 time: 0.106794 Nov 09 10:39:31.578526 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 375/755] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:31 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1255 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:32.605393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:32.606036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:32.617562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:32.618905 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:32.620250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:32.629661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:32.692079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:32.699934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0209ba85-0080-4012-a65b-fa0aa56615fe tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1329 microversion: 2.1 time: 0.098815 Nov 09 10:39:32.700540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 381/756] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:32 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:33.717649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:33.718325 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:33.736542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:33.737358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:33.738384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:33.739204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:34.087060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:34.100586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-141f36ff-8712-4a61-85d4-79e2aad6a192 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.386458 Nov 09 10:39:34.112256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 376/757] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:33 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:34.785314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-98d1c3ff-7700-47fb-9576-47917ec922b0 req-53c2ca1d-f491-4417-9d63-9400cb2b3153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:34.788791 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:34.788791 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:39:34.797794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-98d1c3ff-7700-47fb-9576-47917ec922b0 req-53c2ca1d-f491-4417-9d63-9400cb2b3153 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:34.798761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-98d1c3ff-7700-47fb-9576-47917ec922b0 req-53c2ca1d-f491-4417-9d63-9400cb2b3153 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:34.822361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-98d1c3ff-7700-47fb-9576-47917ec922b0 req-53c2ca1d-f491-4417-9d63-9400cb2b3153 service nova] Creating event network-changed:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:39:34.831000 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-98d1c3ff-7700-47fb-9576-47917ec922b0 req-53c2ca1d-f491-4417-9d63-9400cb2b3153 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051897 Nov 09 10:39:34.832256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 382/758] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:35.119413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:35.120144 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:35.127587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:35.128173 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:35.129037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:35.129549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:35.289853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:35.305912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-518b3619-0a92-4ba6-b455-937dc89d653a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.190211 Nov 09 10:39:35.313705 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 377/759] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:35 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:35.578233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:35.578474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:35.585710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:35.586547 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:35.587754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:35.588538 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:35.697879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lazy-loading 'services' on Instance uuid d3da8b9c-fc0f-4199-aaa2-b668a78be88b {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:39:35.996985 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bcbd8756-93e5-45fe-ba4a-dfb672e8c512 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b/os-volume_attachments/2c7cb2cd-0583-4980-814b-539953ca2e39" status: 202 len: 0 microversion: 2.1 time: 0.422352 Nov 09 10:39:35.999175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 383/760] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:39:35 2021] DELETE /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b/os-volume_attachments/2c7cb2cd-0583-4980-814b-539953ca2e39 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:39:36.324422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:36.324962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:36.331665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:36.337527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:36.337527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:36.337527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:36.605778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:36.614115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b6ab5267-f544-4235-8ef1-4876a7ec375d tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.293584 Nov 09 10:39:36.614737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 378/761] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:36 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:37.631659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:37.633021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:37.639728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:37.640456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:37.641730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:37.642619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:37.951083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:37.960330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c7d318b4-8a8a-41d7-90e8-a662161704aa tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.333158 Nov 09 10:39:37.960914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 384/762] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:37 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:38.978047 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:38.979280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:38.994435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:38.995323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:38.996139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:38.997288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:39.178619 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:39.188603 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-022be8e1-c3ea-4ec7-9423-27f05031df55 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.214239 Nov 09 10:39:39.201246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 379/763] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:38 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:40.207508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:40.209674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:40.216892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:40.217580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:40.218741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:40.219726 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:40.391113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:40.399527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e73ddfa6-430b-4f12-b95d-0e6390180190 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.196643 Nov 09 10:39:40.400316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 385/764] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:40 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:41.416725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:41.417342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:41.423362 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:41.423808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:41.424626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:41.425058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:41.649570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:41.658776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a285fda2-6b87-4a8b-8c2a-b99e35683f24 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.245968 Nov 09 10:39:41.791937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 380/765] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:41 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:42.801729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:42.803417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:42.810915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:42.811623 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:42.812561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:42.818143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:42.962650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:42.969816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f6635a31-b8d7-4e15-9e3f-e57c98969ebf tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.172767 Nov 09 10:39:42.970380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 386/766] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:42 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:43.987055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:44.009344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:44.009344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:44.009344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:44.009344 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:44.009750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:44.144742 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:44.166152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ff1bf6a2-92b8-4cd8-8d76-d5132cbe13e9 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.182490 Nov 09 10:39:44.168453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 381/767] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:43 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:45.185105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:45.185724 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:45.192315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:45.192808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:45.193665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:45.194108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:45.351586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:45.359217 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-078ba3b3-562d-4678-ad67-675b4639e3b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.178117 Nov 09 10:39:45.359793 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 387/768] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:45 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:46.405484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:46.405484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:46.405484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:46.405484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:46.407393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:46.407393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:46.626539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:46.634934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9f9eefaf-8da9-42c4-a39e-2ee758dc9c20 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.261328 Nov 09 10:39:46.637130 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 382/769] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:46 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:47.654387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:47.660512 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:47.668299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:47.668746 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:47.669671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:47.669977 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:47.990992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:47.991577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:47.998216 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:47.998658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:47.999467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:47.999857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:48.026696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:39:48.151723 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:48.159450 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bf705c40-4349-4dae-83fd-93c638e4cc50 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.510346 Nov 09 10:39:48.160429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 388/770] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:47 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:48.300026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ec1861be-41bb-43cd-90ad-7f8d2ed9a770 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 204 len: 0 microversion: 2.1 time: 0.311032 Nov 09 10:39:48.303103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 383/771] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:39:47 2021] DELETE /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 10:39:48.318498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:48.319040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:48.327146 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:48.328550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:48.329547 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:48.330184 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:48.476741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:48.484366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7db75610-d0fe-40be-a9c7-dd12a06bf79c tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1514 microversion: 2.1 time: 0.170907 Nov 09 10:39:48.485029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 389/772] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:48 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:49.175836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:49.176578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:49.183101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:49.183543 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:49.184337 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:49.184765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:49.327416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:49.335327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e60f56d7-de7a-44f1-b8e2-91e07ab255fd tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.163523 Nov 09 10:39:49.335889 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 384/773] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:49 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:49.502196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:49.503163 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:49.509711 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:49.510154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:49.510952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:49.511377 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:49.673344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:49.682059 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cc6988a1-2450-4109-80ec-e864f7ad16a3 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1514 microversion: 2.1 time: 0.183318 Nov 09 10:39:49.689081 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 390/774] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:49 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:50.353405 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:50.354035 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:50.362247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:50.362693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:50.363645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:50.364281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:50.599435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:50.606776 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-28dbf96e-bb34-43ca-88b1-0113edbb083e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.256958 Nov 09 10:39:50.607456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 385/775] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:50 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:50.698753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:50.699876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:50.706435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:50.706974 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:50.707940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:50.708974 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:50.846030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-780520447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1411780037", "security_groups": [{"name": "tempest-secgroup-smoke-1547195770"}], "networks": [{"uuid": "2fdcf95c-e1fc-4011-9f83-26a3b67584bf"}], "block_device_mapping_v2": [{"uuid": "59e3e435-5254-4fb2-999f-d44040556eb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:50.866851 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:50.882011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9196da87-539b-4efb-a48f-062497916923 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1514 microversion: 2.1 time: 0.181429 Nov 09 10:39:50.882011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 391/776] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:50 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:50.994792 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] validate_networks() for [('2fdcf95c-e1fc-4011-9f83-26a3b67584bf', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:39:51.368051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:39:51.368051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:39:51.368051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:39:51.368720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:39:51.368720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:39:51.377457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.377916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.378727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.379195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.395556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for project 06af7c886c064b628757c347296afd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:39:51.399517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Getting quotas for user 6a77eac8a3514e57b3cfea42325759dc and project 06af7c886c064b628757c347296afd9f. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:39:51.457926 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:39:51.460169 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59e3e435-5254-4fb2-999f-d44040556eb3',volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:39:51.602199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-0dfcb103-ff41-4d02-9c20-d955bfc51f60 req-ea544d26-4794-4d5b-b3f0-1b67b3eabeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3da8b9c-fc0f-4199-aaa2-b668a78be88b", "name": "network-vif-deleted", "tag": "6fa822c3-beb1-4f0a-be68-a45ff676e4b8"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:51.603889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:51.603889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:39:51.612768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0dfcb103-ff41-4d02-9c20-d955bfc51f60 req-ea544d26-4794-4d5b-b3f0-1b67b3eabeee service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.613214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-0dfcb103-ff41-4d02-9c20-d955bfc51f60 req-ea544d26-4794-4d5b-b3f0-1b67b3eabeee service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.625598 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-0dfcb103-ff41-4d02-9c20-d955bfc51f60 req-ea544d26-4794-4d5b-b3f0-1b67b3eabeee service nova] Creating event network-vif-deleted:6fa822c3-beb1-4f0a-be68-a45ff676e4b8 for instance d3da8b9c-fc0f-4199-aaa2-b668a78be88b on hv-cinder-81662 Nov 09 10:39:51.630776 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-0dfcb103-ff41-4d02-9c20-d955bfc51f60 req-ea544d26-4794-4d5b-b3f0-1b67b3eabeee service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 Nov 09 10:39:51.631394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 392/777] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:51.639442 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:51.639955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:51.646731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.647474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.648497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.648935 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.798037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:51.807874 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a79d2ae7-9a91-4e87-87fb-4f02b605d434 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.172466 Nov 09 10:39:51.808614 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 393/778] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:51 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:51.897030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:51.898153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:51.904400 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.905142 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.906098 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:51.906666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:51.979907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018de1115494407b913906aa29ec3316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640b54f9b67c485a84c3d04294d65400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:51.988896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-be958c98-5af2-465b-9640-165b044d548f tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 200 len: 1303 microversion: 2.1 time: 0.096415 Nov 09 10:39:51.990704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 394/779] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:51 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:52.175856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-30f9257b-c2b8-48f5-90ba-b0d6f9b9f90f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.333572 Nov 09 10:39:52.176634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 386/780] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:39:50 2021] POST /compute/v2.1/servers => generated 406 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 09 10:39:52.189493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-15d617e7-3f7b-49be-957e-9b9238ab98e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:52.190546 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-15d617e7-3f7b-49be-957e-9b9238ab98e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:52.253038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15d617e7-3f7b-49be-957e-9b9238ab98e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:52.261032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-15d617e7-3f7b-49be-957e-9b9238ab98e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1088 microversion: 2.1 time: 0.076152 Nov 09 10:39:52.271849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 395/781] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:52 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:52.825718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:52.826474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:52.834806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:52.835510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:52.836361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:52.836971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:52.977909 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:52.985380 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e37fa9f8-b526-4bdc-b9a4-67ed27d9ec63 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.163417 Nov 09 10:39:52.985952 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 387/782] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:52 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:53.006856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:53.007460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] [instance: d3da8b9c-fc0f-4199-aaa2-b668a78be88b] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:53.014188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:53.014631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:53.015489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:53.015920 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:53.029911 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] HTTP exception thrown: Instance d3da8b9c-fc0f-4199-aaa2-b668a78be88b could not be found. Nov 09 10:39:53.030508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] Returning 404 to user: Instance d3da8b9c-fc0f-4199-aaa2-b668a78be88b could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:39:53.031426 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-979bc205-0a42-4e59-968e-39705b677d50 tempest-VolumesSnapshotTestJSON-1557777950 tempest-VolumesSnapshotTestJSON-1557777950-project] 10.222.0.35 "GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b" status: 404 len: 111 microversion: 2.1 time: 0.028816 Nov 09 10:39:53.032110 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 396/783] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:53 2021] GET /compute/v2.1/servers/d3da8b9c-fc0f-4199-aaa2-b668a78be88b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:39:53.277425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-47ac133a-b7ef-47ce-bdfa-c8d9c4bdf7df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:53.278033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-47ac133a-b7ef-47ce-bdfa-c8d9c4bdf7df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:53.333862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-47ac133a-b7ef-47ce-bdfa-c8d9c4bdf7df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:53.341703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-47ac133a-b7ef-47ce-bdfa-c8d9c4bdf7df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1088 microversion: 2.1 time: 0.067841 Nov 09 10:39:53.342291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 388/784] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:53 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:54.003604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:54.004267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:54.012767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:54.013364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:54.013991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:54.014439 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:54.168434 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:54.178201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-df4deefb-3403-41fb-b9d9-b8d4212ce2ec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.178282 Nov 09 10:39:54.178777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 397/785] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:53 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:54.307683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-9aa75a49-62d9-45bb-b024-89ac2531d02c req-b32e9b9c-81bf-4ad0-b541-2ac0b1dccafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "name": "network-vif-plugged", "status": "completed", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:54.310109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:54.310109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:39:54.320593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9aa75a49-62d9-45bb-b024-89ac2531d02c req-b32e9b9c-81bf-4ad0-b541-2ac0b1dccafa service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:54.321078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9aa75a49-62d9-45bb-b024-89ac2531d02c req-b32e9b9c-81bf-4ad0-b541-2ac0b1dccafa service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:54.333492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-9aa75a49-62d9-45bb-b024-89ac2531d02c req-b32e9b9c-81bf-4ad0-b541-2ac0b1dccafa service nova] Creating event network-vif-plugged:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:39:54.340317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-9aa75a49-62d9-45bb-b024-89ac2531d02c req-b32e9b9c-81bf-4ad0-b541-2ac0b1dccafa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Nov 09 10:39:54.341767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 389/786] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:54.361077 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:54.362275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:54.369011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:54.369574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:54.370483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:54.370927 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:54.436443 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:54.444883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cc00f44b-6092-43b0-9059-e698cbd4b927 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1186 microversion: 2.1 time: 0.089252 Nov 09 10:39:54.449907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 398/787] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:54 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:55.195017 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:55.199635 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:55.201914 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:55.202363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:55.203181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:55.203691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:55.401699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:55.410984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-62f0dbe8-502d-4b7d-b631-2ede5e2cba17 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.220078 Nov 09 10:39:55.412506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 390/788] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:55 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:55.462211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:55.463144 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:55.470422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:55.470868 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:55.471676 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:55.472277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:55.533888 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:55.542267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3aea7e3f-b02a-48d1-86b6-18fb167656aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1204 microversion: 2.1 time: 0.084260 Nov 09 10:39:55.543011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 399/789] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:55 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:56.427052 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:56.428264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:56.436961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:56.437453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:56.438241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:56.438701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:56.559730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:56.560497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:56.566613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:56.567171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:56.567945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:56.569046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:56.574108 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:56.581585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bbd2254c-cacb-4f26-986f-95baea4fad78 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.158209 Nov 09 10:39:56.582157 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 391/790] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:56 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:56.704388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:56.711957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d3c7bcb9-d700-4886-9748-2d7152f0b010 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1272 microversion: 2.1 time: 0.156068 Nov 09 10:39:56.712677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 400/791] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:56 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:57.598199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:57.598905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:57.605427 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:57.605866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:57.606629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:57.607055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:57.729241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:57.729855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:57.737085 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:57.737520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:57.738352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:57.739205 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:57.742396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:57.750440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-364c64f3-16e2-4650-9b6e-a3285573bb91 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.155842 Nov 09 10:39:57.751182 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 392/792] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:57 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:58.013258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:58.022544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7208e620-5696-473b-8d3f-ac594f5b98ea tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1272 microversion: 2.1 time: 0.297373 Nov 09 10:39:58.023127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 401/793] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:57 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:39:58.594309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-99cb90ea-7fb2-46c9-9c00-4657e7b91dbc req-2bddf268-2916-4bee-85ff-33946e0db547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:39:58.595829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:39:58.595829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:39:58.603392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-99cb90ea-7fb2-46c9-9c00-4657e7b91dbc req-2bddf268-2916-4bee-85ff-33946e0db547 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:58.604274 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-99cb90ea-7fb2-46c9-9c00-4657e7b91dbc req-2bddf268-2916-4bee-85ff-33946e0db547 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:58.616273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-99cb90ea-7fb2-46c9-9c00-4657e7b91dbc req-2bddf268-2916-4bee-85ff-33946e0db547 service nova] Creating event network-changed:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:39:58.621418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-99cb90ea-7fb2-46c9-9c00-4657e7b91dbc req-2bddf268-2916-4bee-85ff-33946e0db547 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030388 Nov 09 10:39:58.622024 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 393/794] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:39:58.767489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:58.768157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:58.775062 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:58.776674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:58.776674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:58.776958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:58.990862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:58.998545 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2f2963e2-2668-45b7-b87e-b634f31da2f2 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1359 microversion: 2.1 time: 0.234729 Nov 09 10:39:58.999118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 402/795] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:58 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:39:59.040491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:39:59.041188 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:39:59.047250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:59.047749 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:59.048580 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:39:59.049108 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:39:59.195445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:39:59.208305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8d9f5402-8f05-4543-bb0c-c258655fa79e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1272 microversion: 2.1 time: 0.172588 Nov 09 10:39:59.209649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 394/796] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:39:59 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:00.016734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:00.017358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:00.023741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.024257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.025053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.025489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.175259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:00.183734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-32092aa4-5395-442e-9726-811611075ea1 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1550 microversion: 2.1 time: 0.172686 Nov 09 10:40:00.184346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 403/797] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:00 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:00.212671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:00.215686 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:00.230260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:00.235148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:00.241455 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.243020 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.244666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.245951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.248675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.249711 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.251276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.252092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.434526 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:00.442495 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f96bd38e-b26f-45ff-bb6f-bd19fc2a304b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1550 microversion: 2.1 time: 0.236672 Nov 09 10:40:00.443306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 395/798] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:00 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:00.461194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:00.464674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:00.464674 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:40:00.465721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:00.466536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Searching by: {'deleted': False, 'project_id': 'b538f1548c3549a188cafef15f81b59c'} {{(pid=122673) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 09 10:40:00.483193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.483193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.483193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.483193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.483658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:00.485041 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1ec54bbd-0526-4043-a1bc-cb4849dd4232 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1272 microversion: 2.1 time: 0.261436 Nov 09 10:40:00.485634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 404/799] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:00 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:00.569905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.multi_cell_list [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122673) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 09 10:40:00.674161 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9a383f6a-eae6-42a7-a5ad-31f63bdd0602 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219393 Nov 09 10:40:00.674756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 396/800] 10.222.0.35 () {58 vars in 1124 bytes} [Tue Nov 9 10:40:00 2021] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:40:00.686334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:00.686334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:00.693805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.694266 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.695064 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:00.695502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:00.831447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:00.839951 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-27e77511-e8e8-4296-a505-96e3c9755d9c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1550 microversion: 2.1 time: 0.158558 Nov 09 10:40:00.840668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 405/801] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:00 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:01.504585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:01.508468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:01.512194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:01.512647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:01.513507 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:01.513930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:01.660275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:01.675051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b748f848-3067-4ae1-b7a5-b1c79f73c91a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.173880 Nov 09 10:40:01.676255 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 397/802] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:01 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:02.694294 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:02.695229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:02.701871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:02.702318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:02.703099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:02.703531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:02.847410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:02.855676 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0d711ebc-b98e-447b-bb5c-d055fbbd79a7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.165955 Nov 09 10:40:02.856308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 406/803] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:02 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:03.145394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1f2755d-df4a-4ab3-b614-550f20bf86a5"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:03.146552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:03.155192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.156267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.157067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.157528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.291939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:03.292451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:03.304617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.306104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.306104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.306379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.337072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2af7e70e-e1a5-4e2e-b096-0465c530d2b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments/d2476d71-ddcc-47e9-a1f5-ec619b7d5645" status: 200 len: 194 microversion: 2.20 time: 0.048906 Nov 09 10:40:03.337677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 407/804] 10.222.0.35 () {60 vars in 1453 bytes} [Tue Nov 9 10:40:03 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments/d2476d71-ddcc-47e9-a1f5-ec619b7d5645 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:40:03.793461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:03.796608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:03.801493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.802075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.803837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:03.804219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:03.961038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lazy-loading 'services' on Instance uuid e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:40:04.353897 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2c4fc7d6-b488-4885-99e2-caa9f10c54e9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments/d2476d71-ddcc-47e9-a1f5-ec619b7d5645" status: 202 len: 0 microversion: 2.20 time: 0.564131 Nov 09 10:40:04.354502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 408/805] 10.222.0.35 () {60 vars in 1456 bytes} [Tue Nov 9 10:40:03 2021] DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments/d2476d71-ddcc-47e9-a1f5-ec619b7d5645 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 09 10:40:04.359486 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:04.360229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:04.366768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:04.367220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:04.368029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:04.368461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:04.509657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:04.517238 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8cdf52fd-9783-43d6-a647-9fdb610dfb35 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.161599 Nov 09 10:40:04.517815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 409/806] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:04 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:04.523171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:04.524188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:04.530260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:04.534995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:04.534995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:04.534995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:04.561466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8c6b8cf7-df7e-4976-9bc8-1951dabeb9ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042392 Nov 09 10:40:04.563022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 410/807] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Nov 9 10:40:04 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:40:04.775915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0969df1e-5251-41d1-836b-ace2b0886d67 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.634444 Nov 09 10:40:04.776606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 398/808] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:40:03 2021] POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments => generated 194 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:05.534607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:05.535229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:05.542304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:05.542743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:05.543507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:05.543956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:05.574605 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:05.575661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:05.582068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:05.582512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:05.583288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:05.584296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:05.616112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cac154ce-ad6c-49a4-80a7-f3249a19ba5f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046163 Nov 09 10:40:05.616677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 399/809] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Nov 9 10:40:05 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:40:05.687085 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:05.695015 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7e0a4e6c-3296-421e-853e-7cabb3da88e0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.164018 Nov 09 10:40:05.704684 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 411/810] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:05 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:06.627888 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:06.635261 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:06.635737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.636232 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.637015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.637444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.667397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7edfe68f-50e9-4b85-abc2-d12d2e12b7ef tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043192 Nov 09 10:40:06.668071 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 400/811] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Nov 9 10:40:06 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:06.712218 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:06.712834 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:06.730057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.730057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.730057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.730057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.735396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:06.735891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:06.742051 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.742490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.743484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:06.744096 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:06.773828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:40:06.897690 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:06.905960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6f828d2d-5354-4c64-9281-bf8cd96d33b3 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.198045 Nov 09 10:40:06.906785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 412/812] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:06 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:07.204961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f2efefc7-1c64-4b57-9cd8-268b8d273111 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 204 len: 0 microversion: 2.20 time: 0.472886 Nov 09 10:40:07.205589 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 401/813] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Nov 9 10:40:06 2021] DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 09 10:40:07.213590 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:07.214219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:07.220117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:07.220594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:07.221369 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:07.221795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:07.360257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:07.369318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:07.370819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:07.372304 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-15a18cab-2fc8-4fc0-9e00-c9583c598e03 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.162323 Nov 09 10:40:07.372879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 413/814] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:07 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:07.925958 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:07.926813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:07.933977 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:07.934429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:07.935204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:07.935827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:08.089097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:08.096993 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a4dc2e1e-30d0-4521-bb02-a4b3e3b26843 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.175143 Nov 09 10:40:08.097518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 402/815] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:07 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:08.390623 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:08.391299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:08.397990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:08.398923 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:08.399241 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:08.399674 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:08.538297 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:08.544719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:08.546224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:08.547370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-261dc795-92c4-4cc2-a76d-8e59e6836270 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.160552 Nov 09 10:40:08.547923 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 414/816] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:08 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:09.113813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:09.114538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:09.121331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:09.121777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:09.125424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:09.125424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:09.269737 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:09.278949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0ea3ab0a-18e0-43fa-bc91-7acb8f7450b8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.168797 Nov 09 10:40:09.279539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 403/817] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:09 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:09.566004 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:09.567261 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:09.574999 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:09.575449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:09.576455 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:09.576889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:09.761672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:09.770011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:09.771752 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:09.773131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-70c5d8cf-491c-4a80-86fd-034b65c55c15 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.211058 Nov 09 10:40:09.773698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 415/818] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:09 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:10.297425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:10.298428 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:10.306352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:10.306940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:10.307998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:10.309975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:10.483400 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:10.492559 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d91c2e44-1af1-498f-8516-86f1e3ef25d0 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.199281 Nov 09 10:40:10.493477 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 404/819] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:10 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:10.791337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:10.791908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:10.798729 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:10.799179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:10.799991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:10.800428 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:11.339493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:11.352912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:11.355339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:11.356856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3c422015-5056-479b-9d01-559cfd66be6c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1720 microversion: 2.20 time: 0.570046 Nov 09 10:40:11.357824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 416/820] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:10 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1720 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:11.509820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:11.510430 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:11.516673 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:11.517117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:11.517894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:11.518328 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:11.647871 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:11.655091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-51da3abb-9d53-4650-82cb-6a749d7c8969 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.148926 Nov 09 10:40:11.655748 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 405/821] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:11 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:12.156119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-611a2e62-2005-4de5-9100-142b066a7d27 req-504a483d-34d0-4cf9-9841-11437e8c6a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13b163e-1659-4e4c-ba93-9b4c0b05a6f8", "name": "network-vif-deleted", "tag": "07b8bf6a-cca9-4efb-8c77-23793d3ff931"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:12.162670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:12.162670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:12.171021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-611a2e62-2005-4de5-9100-142b066a7d27 req-504a483d-34d0-4cf9-9841-11437e8c6a3c service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:12.171461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-611a2e62-2005-4de5-9100-142b066a7d27 req-504a483d-34d0-4cf9-9841-11437e8c6a3c service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:12.183865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-611a2e62-2005-4de5-9100-142b066a7d27 req-504a483d-34d0-4cf9-9841-11437e8c6a3c service nova] Creating event network-vif-deleted:07b8bf6a-cca9-4efb-8c77-23793d3ff931 for instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 on hv-cinder-81662 Nov 09 10:40:12.189391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-611a2e62-2005-4de5-9100-142b066a7d27 req-504a483d-34d0-4cf9-9841-11437e8c6a3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039344 Nov 09 10:40:12.190508 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 417/822] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:12.388032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:12.388651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:12.395532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:12.399428 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:12.404053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:12.404053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:12.482819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:12.491846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:12.493412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:12.494586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e95f48e7-56a0-4e88-86eb-284b57a29790 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 200 len: 1364 microversion: 2.20 time: 0.110342 Nov 09 10:40:12.495150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 406/823] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:12 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 1364 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:12.673281 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:12.674151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:12.681540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:12.681990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:12.683517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:12.684054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:12.941126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:12.965316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4d7ab392-21cc-4e90-8930-ebf10aa12f6a tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.296480 Nov 09 10:40:12.979607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 418/824] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:12 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:13.514493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:13.515905 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:13.527363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:13.528694 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:13.530989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:13.532466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:13.561343 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. Nov 09 10:40:13.562086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:40:13.563060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-53cf1338-8aa5-4c53-9a1c-bbb1415f0c94 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 404 len: 111 microversion: 2.20 time: 0.054039 Nov 09 10:40:13.567865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 407/825] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:13 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:40:13.572318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d3414760-91d7-4417-914e-93d24828f583 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '.version_select at 0x7f53dcf7e550>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:13.721104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d3414760-91d7-4417-914e-93d24828f583 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76977645" status: 204 len: 0 microversion: 2.20 time: 0.152445 Nov 09 10:40:13.721704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 419/826] 10.222.0.35 () {60 vars in 1255 bytes} [Tue Nov 9 10:40:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76977645 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 09 10:40:13.986419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:13.987019 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:13.993474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:13.993919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:13.994719 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:13.995126 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:14.232181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:14.244291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-57203804-824f-4573-933f-5f97a3dcf47b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.261373 Nov 09 10:40:14.245535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 408/827] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:13 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:14.827250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: .version_select at 0x7f53dd057b80>, body: {"keypair": {"name": "tempest-keypair-1530813711"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:14.842116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:40:14.846451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:40:15.048747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-61f2b3b3-63a4-460d-aca5-e2a8e1e1cb98 req-78c6df0d-2b59-47d8-bf63-69529fa9796f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "name": "network-vif-plugged", "status": "completed", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:15.050326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:15.050326 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:40:15.058924 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-61f2b3b3-63a4-460d-aca5-e2a8e1e1cb98 req-78c6df0d-2b59-47d8-bf63-69529fa9796f service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:15.059413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-61f2b3b3-63a4-460d-aca5-e2a8e1e1cb98 req-78c6df0d-2b59-47d8-bf63-69529fa9796f service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:15.071735 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-61f2b3b3-63a4-460d-aca5-e2a8e1e1cb98 req-78c6df0d-2b59-47d8-bf63-69529fa9796f service nova] Creating event network-vif-plugged:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:40:15.073727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:40:15.077476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-61f2b3b3-63a4-460d-aca5-e2a8e1e1cb98 req-78c6df0d-2b59-47d8-bf63-69529fa9796f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Nov 09 10:40:15.078288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 409/828] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:40:15.078735 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'key_pairs'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:40:15.094887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-838193eb-e014-4887-87b1-ef599d4ba4ce tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.271881 Nov 09 10:40:15.096191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 420/829] 10.222.0.35 () {62 vars in 1198 bytes} [Tue Nov 9 10:40:14 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 274 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 09 10:40:15.284421 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:15.285517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:15.294027 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:15.294502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:15.295273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:15.295747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:15.525079 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:15.540350 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c339947b-82c7-4563-b0be-652fc1dd06b7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.280298 Nov 09 10:40:15.552873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 410/830] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:15 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:16.558473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:16.559685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:16.571799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:16.572298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:16.573286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:16.574040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:16.723432 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:16.732123 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-04afe51b-6d36-45e5-a5f8-f8136c996454 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1260 microversion: 2.1 time: 0.178402 Nov 09 10:40:16.732736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 421/831] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:16 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:16.941989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:16.946796 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:16.949797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:16.950247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:16.951123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:16.951533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:17.314015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:17.323030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8fff61ac-eefd-4789-9a05-f082e8e0fbd3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1596 microversion: 2.1 time: 0.385307 Nov 09 10:40:17.323603 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 411/832] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:16 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1596 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:17.749881 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:17.750569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:17.757745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:17.759115 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:17.760114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:17.760746 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:18.021257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:18.029433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fe1749cd-004d-425b-af33-f9d57c0271e5 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1445 microversion: 2.1 time: 0.283680 Nov 09 10:40:18.030015 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 422/833] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:17 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1445 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:18.045956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:18.046618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:18.053087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:18.056734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:18.056734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:18.056734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:18.307815 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:18.316174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8444019b-2a61-45cc-8179-e9b16b72b6aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1445 microversion: 2.1 time: 0.273703 Nov 09 10:40:18.328807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 412/834] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:18 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1445 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:18.482085 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-368700643", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34358316-6aa9-484d-bebb-9653f7b5c623"}], "security_groups": [{"name": "tempest-securitygroup--1216803691"}], "key_name": "tempest-keypair-1530813711", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:18.731410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] validate_networks() for [('34358316-6aa9-484d-bebb-9653f7b5c623', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:40:20.074937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:40:20.075565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:40:20.075832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:40:20.076487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:40:20.077220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:40:20.092323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:20.092323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:20.092982 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:20.093767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:20.113582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:40:20.120762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Getting quotas for user f48729a25856428f89bca0298d9d3b3a and project 0cd90823f43e4d41be05683e40b3ac62. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:40:20.131772 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:40:20.135462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:40:20.277748 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6cca25bf-6ff1-4ce1-b211-ac819c895921 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.799789 Nov 09 10:40:20.278526 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 423/835] 10.222.0.35 () {62 vars in 1187 bytes} [Tue Nov 9 10:40:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 09 10:40:20.288416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:20.289066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:20.406049 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:20.421408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:20.421408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:20.421408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-fba41eca-b27f-48bb-b97d-adca3520c013 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1281 microversion: 2.20 time: 0.136310 Nov 09 10:40:20.422418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 413/836] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:20 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:20.985573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-6d3164a5-036f-4f4f-aa17-d6d41d3b0331 req-52cc04ec-26ca-447a-b6f8-8947c98beab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:20.987520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:20.987520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:21.004038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-6d3164a5-036f-4f4f-aa17-d6d41d3b0331 req-52cc04ec-26ca-447a-b6f8-8947c98beab7 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:21.004339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-6d3164a5-036f-4f4f-aa17-d6d41d3b0331 req-52cc04ec-26ca-447a-b6f8-8947c98beab7 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:21.028764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-6d3164a5-036f-4f4f-aa17-d6d41d3b0331 req-52cc04ec-26ca-447a-b6f8-8947c98beab7 service nova] Creating event network-changed:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:40:21.035036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-6d3164a5-036f-4f4f-aa17-d6d41d3b0331 req-52cc04ec-26ca-447a-b6f8-8947c98beab7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054798 Nov 09 10:40:21.036255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 424/837] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:21.440577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:21.440577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:21.451829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:21.458018 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:21.460911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:21.461542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:21.559442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:21.569301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:21.570989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:21.572255 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-57b56280-6e7a-4801-ae26-cfe1eb9d4af2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1285 microversion: 2.20 time: 0.136953 Nov 09 10:40:21.585610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 414/838] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:21 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:21.914379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-cafc3d53-3a54-4b5b-b003-4b060d4c04db req-51807901-d451-43c5-baf6-90f99cb5fb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:21.916052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:21.916052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:21.925515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-cafc3d53-3a54-4b5b-b003-4b060d4c04db req-51807901-d451-43c5-baf6-90f99cb5fb7b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:21.926199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-cafc3d53-3a54-4b5b-b003-4b060d4c04db req-51807901-d451-43c5-baf6-90f99cb5fb7b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:21.940683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-cafc3d53-3a54-4b5b-b003-4b060d4c04db req-51807901-d451-43c5-baf6-90f99cb5fb7b service nova] Creating event network-changed:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:40:21.946234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-cafc3d53-3a54-4b5b-b003-4b060d4c04db req-51807901-d451-43c5-baf6-90f99cb5fb7b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035451 Nov 09 10:40:21.946949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 425/839] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:22.590430 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:22.600403 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:22.625384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:22.629027 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:22.630671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:22.634474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:22.770942 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:22.779748 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:22.781911 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:22.783307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-dd9a7c3e-3c80-4816-983d-2387296fdaeb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1333 microversion: 2.20 time: 0.197455 Nov 09 10:40:22.798363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 415/840] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:22 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1333 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:23.803469 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:23.804364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:23.820647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:23.821349 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:23.822278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:23.822790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:23.924995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:23.938222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:23.938455 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:23.940689 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9edcd40e-e50d-402f-a591-1b2c86214903 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1333 microversion: 2.20 time: 0.141820 Nov 09 10:40:23.941482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 426/841] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:23 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:24.925180 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1115581956"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:24.925797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:24.932730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:24.933184 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:24.933971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:24.934406 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:24.965519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:24.966154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:24.972609 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:24.973055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:24.973847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:24.974284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:25.043151 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:25.055962 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:25.060742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:25.060742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ae79f816-1441-4e75-a000-80eda80b6c06 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1333 microversion: 2.20 time: 0.097050 Nov 09 10:40:25.060742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 427/842] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:24 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:25.108747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.network.security_group_api [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Adding security group 78ee30c7-d063-4cce-8aeb-2473ad541ea4 to port 7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff Nov 09 10:40:25.714666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6c7f4198-2aa5-4f52-993e-92c44a5a7994 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action" status: 202 len: 0 microversion: 2.1 time: 0.792300 Nov 09 10:40:25.716279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 416/843] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:40:24 2021] POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:40:25.719346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-262c5033-9c7a-4a3b-a80e-1fcaf59bb057 req-a2e16eee-614e-4704-813d-4afd7c42b8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:25.721107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:25.721107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:25.726054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:25.730432 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:25.732609 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-262c5033-9c7a-4a3b-a80e-1fcaf59bb057 req-a2e16eee-614e-4704-813d-4afd7c42b8ba service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:25.737532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-262c5033-9c7a-4a3b-a80e-1fcaf59bb057 req-a2e16eee-614e-4704-813d-4afd7c42b8ba service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:25.750041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:25.750607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:25.754596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:25.755095 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:25.755744 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-262c5033-9c7a-4a3b-a80e-1fcaf59bb057 req-a2e16eee-614e-4704-813d-4afd7c42b8ba service nova] Creating event network-changed:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:40:25.765742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-262c5033-9c7a-4a3b-a80e-1fcaf59bb057 req-a2e16eee-614e-4704-813d-4afd7c42b8ba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050419 Nov 09 10:40:25.766588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 428/844] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:40:26.050998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:26.060933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c7081f1c-75b8-4461-a460-696cff39ffec tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1761 microversion: 2.1 time: 0.339653 Nov 09 10:40:26.072007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 417/845] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:25 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1761 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:26.078894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:26.079702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:26.094022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:26.094733 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:26.095539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:26.095993 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:26.228282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:26.240671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:26.242865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:26.244657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8625c3a2-0e7a-4628-9751-99626eb6b735 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1341 microversion: 2.20 time: 0.170724 Nov 09 10:40:26.246107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 429/846] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:26 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:40:27.264333 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:27.265054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:27.273088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:27.274095 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:27.275070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:27.275614 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:27.345623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:27.354354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:27.355861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:27.357015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9d69852a-54b3-4649-81ee-016679113676 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1339 microversion: 2.20 time: 0.096992 Nov 09 10:40:27.357585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 418/847] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:27 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:28.376573 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:28.377140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:28.385052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:28.385500 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:28.386283 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:28.386715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:28.527149 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:28.536904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:28.538652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:28.540518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-46ec17fd-f306-4098-ae0a-f65718c3dbfb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.169491 Nov 09 10:40:28.541128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 430/848] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:28 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:29.726332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:29.726963 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:29.733196 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:29.733645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:29.734478 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:29.734904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:29.874521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:29.884281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:29.885996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:29.887198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1e1c88a3-cf63-480b-af50-8e433451d470 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.332391 Nov 09 10:40:29.887766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 419/849] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:29 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:30.904785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:30.906964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:30.918375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:30.918375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:30.919129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:30.920507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:31.202575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:31.212225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:31.213790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:31.214932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1dbba905-6d9c-41fb-8a05-97439fde75a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.313812 Nov 09 10:40:31.215504 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 431/850] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:30 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:31.334501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-069ad803-a51d-4963-8961-e6939999886e req-d86051bc-f79c-40bd-b484-d74222749f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:31.336224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:31.336224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:40:31.345636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-069ad803-a51d-4963-8961-e6939999886e req-d86051bc-f79c-40bd-b484-d74222749f80 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:31.346423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-069ad803-a51d-4963-8961-e6939999886e req-d86051bc-f79c-40bd-b484-d74222749f80 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:31.360252 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-069ad803-a51d-4963-8961-e6939999886e req-d86051bc-f79c-40bd-b484-d74222749f80 service nova] Creating event network-changed:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:40:31.368670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-069ad803-a51d-4963-8961-e6939999886e req-d86051bc-f79c-40bd-b484-d74222749f80 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037694 Nov 09 10:40:31.369987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 420/851] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:32.234735 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:32.235459 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:32.242016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:32.242464 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:32.243250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:32.243684 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:32.378453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:32.393675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:32.395214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:32.396353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fa8f5a5e-03c6-4b23-bae2-6273f75477b8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.165422 Nov 09 10:40:32.397021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 432/852] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:32 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:33.415795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:33.416439 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:33.422783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:33.423225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:33.424048 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:33.424644 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:33.569550 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:33.578072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:33.579559 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:33.580898 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-adc451fc-07a3-4627-8fc2-65b02e445b9d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.170779 Nov 09 10:40:33.581460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 421/853] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:33 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:34.599358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:34.599988 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:34.606259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:34.606647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:34.607413 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:34.607845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:34.741062 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:34.749893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:34.751398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:34.752606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-65a741d2-bcc5-491e-972f-a0d2bc91a72b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.156873 Nov 09 10:40:34.753133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 433/854] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:34 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:35.770671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:35.771279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:35.777537 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:35.777983 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:35.778751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:35.779256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:35.912761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:35.921356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:35.922865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:35.924290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-23c07d5e-0290-4ad4-8422-2c36bda79357 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.157122 Nov 09 10:40:35.924562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 422/855] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:35 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:36.942571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:36.943119 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:36.950163 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:36.950617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:36.951403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:36.951843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:37.091634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:37.099712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:37.101309 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:37.102418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4ff5f5a3-5313-4375-be3f-e74f8b96549f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.163803 Nov 09 10:40:37.102972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 434/856] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:36 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:38.120424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:38.121294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:38.127639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:38.128147 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:38.128927 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:38.129350 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:38.245952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-8553a244-3360-4401-ae8c-043082ce0fe4 req-f6e97c31-3e2e-4ece-84f6-520cd61320d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "name": "network-vif-plugged", "status": "completed", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:38.248141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:38.248141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:38.255889 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8553a244-3360-4401-ae8c-043082ce0fe4 req-f6e97c31-3e2e-4ece-84f6-520cd61320d3 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:38.256361 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-8553a244-3360-4401-ae8c-043082ce0fe4 req-f6e97c31-3e2e-4ece-84f6-520cd61320d3 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:38.269113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-8553a244-3360-4401-ae8c-043082ce0fe4 req-f6e97c31-3e2e-4ece-84f6-520cd61320d3 service nova] Creating event network-vif-plugged:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:40:38.276642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-8553a244-3360-4401-ae8c-043082ce0fe4 req-f6e97c31-3e2e-4ece-84f6-520cd61320d3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Nov 09 10:40:38.277465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 435/857] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:40:38.282474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:38.291757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:38.293367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:38.294469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2a5a7802-282f-425b-a394-bd4506001f71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.177981 Nov 09 10:40:38.295070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 423/858] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:38 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:39.312529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:39.313224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:39.320111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:39.320558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:39.321350 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:39.321780 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:39.472342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:39.481269 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:39.482837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:39.483961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4ea1244c-f319-4efa-8363-63ecf1ab8b85 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1407 microversion: 2.20 time: 0.176039 Nov 09 10:40:39.484548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 436/859] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:39 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:40.501800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:40.503038 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:40.510323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:40.510767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:40.511592 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:40.512045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:40.685253 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:40.694204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:40.696784 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:40.697882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-114e81e2-4354-4477-a451-ab66add3a6e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1599 microversion: 2.20 time: 0.199987 Nov 09 10:40:40.713007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 424/860] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:40:40 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:40:40.723006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:40.724568 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:40.734051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:40.734831 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:40.736111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:40.736631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:40.827494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bb6bdc86-8ad6-4fa0-bf66-3579fdeeeba9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106638 Nov 09 10:40:40.827494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 437/861] 10.222.0.35 () {60 vars in 1315 bytes} [Tue Nov 9 10:40:40 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:40:41.941517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:41.942440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:41.949125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:41.949824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:41.950839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:41.951370 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:42.018508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c109ca21-8a4f-4433-896f-bf88091274cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.086938 Nov 09 10:40:42.021912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 425/862] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:41 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:42.081034 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-7c73cce1-5a7b-47ba-99f2-c73ca7163825 req-398ed7d9-22a3-478d-af86-ce9f2fb02576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:42.082619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:40:42.082619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:40:42.090433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-7c73cce1-5a7b-47ba-99f2-c73ca7163825 req-398ed7d9-22a3-478d-af86-ce9f2fb02576 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:42.090876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-7c73cce1-5a7b-47ba-99f2-c73ca7163825 req-398ed7d9-22a3-478d-af86-ce9f2fb02576 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:42.102513 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-7c73cce1-5a7b-47ba-99f2-c73ca7163825 req-398ed7d9-22a3-478d-af86-ce9f2fb02576 service nova] Creating event network-changed:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:40:42.107811 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-7c73cce1-5a7b-47ba-99f2-c73ca7163825 req-398ed7d9-22a3-478d-af86-ce9f2fb02576 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172613 Nov 09 10:40:42.111135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 438/863] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:40:43.032115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:43.033158 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:43.041701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:43.042127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:43.043145 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:43.043587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:43.112316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bac4e5ae-2b1f-466b-aced-989b751c9461 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.083590 Nov 09 10:40:43.115820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 426/864] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:43 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:44.127440 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:44.129310 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:44.141036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.141848 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:44.143303 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.144126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:44.230797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b1051871-4498-499f-b4d5-c60f81329fe6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.109593 Nov 09 10:40:44.232006 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 439/865] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:44 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:44.610209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:44.612202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:44.625066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.625870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:44.627301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.628104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:44.860969 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-26f9ec63-eea8-4d38-b1f0-1b177226684e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action" status: 202 len: 0 microversion: 2.1 time: 0.258472 Nov 09 10:40:44.865291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 427/866] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:40:44 2021] POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:40:44.874391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:44.875601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:44.884610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.885492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:44.887129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:44.888507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:45.132877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:45.171347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9c140b73-e9d1-4991-a886-bf93a521a395 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1753 microversion: 2.1 time: 0.296401 Nov 09 10:40:45.173052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 440/867] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:44 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1753 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:45.243466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:45.244863 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:45.252049 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:45.252431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:45.253238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:45.253671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:45.338554 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b49cb2ba-b5bd-4c92-9759-a9599f6c8b47 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.099965 Nov 09 10:40:45.339272 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 428/868] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:45 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:46.195127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:46.198135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:46.211113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:46.211706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:46.212872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:46.213769 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:46.351565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:46.354290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:46.368012 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:46.368570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:46.370991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:46.372501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:46.445035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:46.453987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f79c4528-f38d-410a-aeb6-68791e3683b6 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.267349 Nov 09 10:40:46.454540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 441/869] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:46 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:46.473648 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-fdfc8bdb-9279-49c6-95aa-382313a31a71 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.127532 Nov 09 10:40:46.474385 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 429/870] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:46 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:47.470473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:47.471214 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:47.477666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:47.478105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:47.478878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:47.479398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:47.485060 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:47.486268 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:47.493726 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:47.500198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:47.500198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:47.500198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:47.565164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-fa322a52-5e71-4e46-b2bf-c804314fae36 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.083985 Nov 09 10:40:47.569340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 430/871] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:47 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:47.683941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:47.695852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-902b0bd4-b4bb-42be-9d59-6217ee35ee1f tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.228822 Nov 09 10:40:47.701083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 442/872] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:47 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:48.579373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:48.580409 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:48.587817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:48.588587 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:48.589549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:48.590357 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:48.662077 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-046d06d1-491e-4ee0-8844-b2b791c79822 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.086468 Nov 09 10:40:48.663373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 431/873] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:48 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:48.718456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:48.719703 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:48.729727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:48.730495 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:48.731279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:48.731707 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:48.892069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:48.900782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e7daf811-c5cc-4364-a692-d959a7939ce8 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.188001 Nov 09 10:40:48.901392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 443/874] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:48 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:49.673857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:49.675465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:49.683162 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:49.683612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:49.684429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:49.684864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:49.748848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2b23d4e8-4372-4433-91ac-4c9f7ac95bae tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.078991 Nov 09 10:40:49.752420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 432/875] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:49 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:49.918845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:49.919617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:49.929170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:49.929170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:49.929170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:49.929560 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:50.115786 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:50.125342 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-626a551a-029e-4a6b-a5ad-235eab0c6596 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.210636 Nov 09 10:40:50.126087 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 444/876] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:49 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:50.763497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:50.765718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:50.779832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:50.781246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:50.782976 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:50.783778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:50.863030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6aeb7433-d2c4-4800-a5fc-9cfbba920a75 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.106082 Nov 09 10:40:50.864413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 433/877] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:50 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:51.152961 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:51.157528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:51.167219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:51.167954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:51.169628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:51.170364 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:51.504216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:51.512275 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-989e90d9-e637-4b04-ad6d-3bf279d62103 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.370455 Nov 09 10:40:51.513847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 445/878] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:51 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:51.876542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:51.878236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:51.885836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:51.886616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:51.887422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:51.887861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:51.958775 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-238d3e0c-b44a-48c3-89ec-33d0e3ca5df7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.086271 Nov 09 10:40:51.960445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 434/879] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:51 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:52.532656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:52.534914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:52.548003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:52.548776 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:52.550363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:52.551008 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:52.759029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:52.767186 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d6046583-4937-4553-90e5-ef5f44329e68 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.239342 Nov 09 10:40:52.767765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 446/880] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:52 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:52.973685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:52.974892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:52.984436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:52.985152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:52.991028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:52.991028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:53.053641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bb317c04-2b32-4271-be15-257aca6a6c91 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 14 microversion: 2.20 time: 0.084279 Nov 09 10:40:53.054574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 435/881] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:52 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:53.784610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:53.788736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:53.793387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:53.793845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:53.794646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:53.795083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:53.995806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:54.014438 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7407f334-855e-471c-bb81-b6243a5e807a tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.232907 Nov 09 10:40:54.015550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 447/882] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:53 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:54.065664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:54.066790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:54.076026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:54.076578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:54.077773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:54.078222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:54.162112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-19e19779-1eaa-419f-9e73-e3cf863d6858 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 11723 microversion: 2.20 time: 0.101083 Nov 09 10:40:54.163438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 436/883] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:54 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 11723 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:40:55.035861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:55.036859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:55.045466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:55.046851 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:55.048213 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:55.048793 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:55.175110 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:55.185243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:55.194576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:55.195083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:55.196667 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:55.197503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:55.283521 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:55.287549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-527a9373-9d75-49a4-8f76-901240465e7a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 18305 microversion: 2.20 time: 0.116589 Nov 09 10:40:55.290327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 437/884] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:55 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 18305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:40:55.300991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2db57f58-d55b-4896-a14b-4c691e5859e7 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.269195 Nov 09 10:40:55.302228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 448/885] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:55 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:56.303858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:56.305391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:56.323556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:56.324761 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:56.331860 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:56.332352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:56.338124 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:56.338585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:56.339398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:56.339843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:56.342666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:56.343469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:56.470558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1b627d20-88dd-4dcf-9774-4cf375cf75ba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 19133 microversion: 2.20 time: 0.171699 Nov 09 10:40:56.471930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 438/886] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:56 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 19133 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:40:56.608074 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:56.629969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0b078627-d0aa-46a1-ad81-184e7b8826dc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1758 microversion: 2.1 time: 0.310921 Nov 09 10:40:56.631097 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 449/887] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:56 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1758 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:56.829624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Action: 'create', calling method: .version_select at 0x7f53dcdbf310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1262482173"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:56.844713 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for project f193ff8d94534794ba21cabcf0169326. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:40:56.848617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for user e5d350506f684e9da08c4403e84567e4 and project f193ff8d94534794ba21cabcf0169326. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:40:57.203621 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for project f193ff8d94534794ba21cabcf0169326. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:40:57.207257 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for user e5d350506f684e9da08c4403e84567e4 and project f193ff8d94534794ba21cabcf0169326. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:40:57.220751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-27a56f9b-7243-49d0-8fc1-fcc9d62dd87f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.614894 Nov 09 10:40:57.221360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 439/888] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Nov 9 10:40:56 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:40:57.483188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:57.484408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:57.491271 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:57.491723 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:57.493099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:57.493630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:57.601316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-de2baefa-0797-4b6b-b1bc-7f4165a8bc59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 21570 microversion: 2.20 time: 0.121755 Nov 09 10:40:57.602588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 450/889] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:57 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 21570 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:40:57.648417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:40:57.649063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:57.655862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:57.656306 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:57.657134 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:57.657565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:57.850628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:40:57.859225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e0743128-6ef4-43ca-9b12-d76137eba107 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1761 microversion: 2.1 time: 0.215160 Nov 09 10:40:57.859785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 440/890] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:40:57 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1761 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:40:58.614628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:58.615629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:58.622969 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:58.626720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:58.626720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:58.626720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:58.705765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7c1ac193-1879-49c5-83ed-601d2d65f1f3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 23181 microversion: 2.20 time: 0.094918 Nov 09 10:40:58.707380 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 451/891] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:58 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 23181 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:40:59.718995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:40:59.720047 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:40:59.726957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:59.727332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:59.728251 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:40:59.728709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:40:59.814925 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6a8f77fb-bb3c-4b86-a32e-967d56352c58 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 24401 microversion: 2.20 time: 0.099490 Nov 09 10:40:59.815903 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 441/892] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:40:59 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 24401 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:00.827580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:00.828677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:00.836493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:00.837032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:00.837825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:00.838263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:00.917576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e34f688c-95a5-48ef-ab77-ed50d5558680 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 25971 microversion: 2.20 time: 0.093856 Nov 09 10:41:00.918116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 452/893] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:00 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 25971 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:01.929890 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:01.930979 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:01.938097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:01.938546 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:01.939341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:01.939823 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:02.017152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b762d0c9-d398-45f9-a6b0-64605d3b1dd3 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 27053 microversion: 2.20 time: 0.091127 Nov 09 10:41:02.018108 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 442/894] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:01 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 27053 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:03.029487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:03.030513 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:03.038099 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:03.038543 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:03.039833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:03.040295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:03.124084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1c5b295b-21e7-47cf-8706-abe040f75fba tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 27659 microversion: 2.20 time: 0.098587 Nov 09 10:41:03.124741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 453/895] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:03 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 27659 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:04.136988 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:04.138217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:04.145451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:04.145897 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:04.146686 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:04.147116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:04.236222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4039256a-1070-48b6-a57b-62741539ee39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28020 microversion: 2.20 time: 0.104018 Nov 09 10:41:04.237123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 443/896] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:04 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28020 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:05.249663 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:05.250668 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:05.257917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:05.258367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:05.259179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:05.259637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:05.343753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-19760625-1623-4145-a2ca-c4be7eddc0ea tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28207 microversion: 2.20 time: 0.098334 Nov 09 10:41:05.344452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 454/897] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:05 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:06.357423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:06.358332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:06.365853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:06.366302 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:06.367082 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:06.367516 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:06.460069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d651de64-0997-4246-a297-94c9215b078b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28334 microversion: 2.20 time: 0.107227 Nov 09 10:41:06.461062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 444/898] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:06 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:07.474384 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:07.475355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:07.482675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:07.483393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:07.483824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:07.484243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:07.573436 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-331ab94e-3b3a-409a-8b68-cd5f0b703199 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28498 microversion: 2.20 time: 0.102354 Nov 09 10:41:07.574894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 455/899] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:07 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28498 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:08.585683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:08.586736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:08.593851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:08.594328 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:08.595096 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:08.595527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:08.689276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3a0d8143-81a8-4842-84d2-ff2b93cde2f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28666 microversion: 2.20 time: 0.106004 Nov 09 10:41:08.690008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 445/900] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:08 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28666 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:09.702429 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:09.703604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:09.710695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:09.711148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:09.711941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:09.712407 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:09.782664 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7e95f440-c047-4207-a9eb-273ef488e0cd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28666 microversion: 2.20 time: 0.084765 Nov 09 10:41:09.783478 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 456/901] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:09 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28666 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:10.794101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:10.795091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:10.802299 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:10.802678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:10.803465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:10.803892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:10.870582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e1cae2d1-0e63-4993-baac-17aefcd2eb1d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28666 microversion: 2.20 time: 0.079543 Nov 09 10:41:10.871382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 446/902] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:10 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28666 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:11.882980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:11.883895 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:11.890859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:11.891302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:11.892117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:11.892548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:11.964449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aed7f2c2-14fa-421d-9c76-b135e7ccfd5b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 28666 microversion: 2.20 time: 0.085483 Nov 09 10:41:11.965093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 457/903] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:11 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 28666 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:12.976657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:12.977764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:12.985720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:12.985720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:12.986194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:12.986658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:13.069544 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-97dc3f07-6035-47ee-b67d-93f82acbb715 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 29845 microversion: 2.20 time: 0.096789 Nov 09 10:41:13.070198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 447/904] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:12 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 29845 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:14.084907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:14.084907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:14.090926 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:14.091418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:14.092226 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:14.092662 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:14.176601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-42143630-2172-4419-902b-7676c9fb3cfa tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 31523 microversion: 2.20 time: 0.098145 Nov 09 10:41:14.177480 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 458/905] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:14 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 31523 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:15.189083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:15.190133 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:15.200601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:15.201083 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:15.201872 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:15.202297 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:15.281594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0a2218f5-dcbb-4b39-9759-c6c963132089 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 32841 microversion: 2.20 time: 0.096410 Nov 09 10:41:15.282249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 448/906] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:15 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 32841 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:16.294978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:16.296150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:16.303084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:16.303532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:16.304348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:16.304785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:16.381990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0472ba09-df21-4407-bfd3-31f76fd54d81 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 33633 microversion: 2.20 time: 0.091481 Nov 09 10:41:16.382612 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 459/907] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:16 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 33633 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:17.393609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:17.394610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:17.401682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:17.402127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:17.402912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:17.403342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:17.478598 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e79edd2b-21a6-4a2e-ac5e-f88a92cad880 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 34617 microversion: 2.20 time: 0.088902 Nov 09 10:41:17.479417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 449/908] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:17 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 34617 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:18.491094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:18.492111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:18.499423 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:18.499873 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:18.500740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:18.501169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:18.572871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-715c56b6-02cd-44ca-8808-408911fe760d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 35243 microversion: 2.20 time: 0.085032 Nov 09 10:41:18.573522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 460/909] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:18 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 35243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:19.154879 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1718007140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262482173", "security_groups": [{"name": "tempest-secgroup-smoke-1418179760"}], "block_device_mapping_v2": [{"uuid": "c88e71b3-9b08-41b4-a885-6a0e8a163a31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9ec3b3d-16d6-42bb-8661-ba5a7b86073a"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:19.267520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] validate_networks() for [('d9ec3b3d-16d6-42bb-8661-ba5a7b86073a', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:41:19.585291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:19.586292 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:19.593781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:19.594222 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:19.595032 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:19.595462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:19.672827 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4dc2ace2-0057-4e84-8985-44d8280eb9f5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 36566 microversion: 2.20 time: 0.091496 Nov 09 10:41:19.673767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 461/910] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:19 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 36566 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:41:19.722793 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:41:19.723213 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:41:19.723689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:41:19.724239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:41:19.724552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:41:19.733752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:19.734194 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:19.734996 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:19.735428 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:19.751601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:41:19.755407 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for user e5d350506f684e9da08c4403e84567e4 and project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:41:19.812916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:41:19.815417 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c88e71b3-9b08-41b4-a885-6a0e8a163a31',volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:41:20.343946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ad233b85-c5f3-4611-90fb-63a0e8e94fe6 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.193374 Nov 09 10:41:20.344683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 450/911] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:41:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:41:20.355822 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6699134b-f251-44da-8553-ef21577fc95f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:20.356572 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6699134b-f251-44da-8553-ef21577fc95f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:20.419318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6699134b-f251-44da-8553-ef21577fc95f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:20.425956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6699134b-f251-44da-8553-ef21577fc95f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1095 microversion: 2.1 time: 0.074854 Nov 09 10:41:20.426592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 462/912] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:20 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:20.686121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:20.687475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:20.694139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:20.694581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:20.695373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:20.695808 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:20.775575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f7412e91-0eaf-4e50-b2da-387c4a5c1a33 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 37988 microversion: 2.20 time: 0.093962 Nov 09 10:41:20.776521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 451/913] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:20 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 37988 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:41:21.443376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-00a96ebd-b217-4f61-a27c-41f7b76328ad tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:21.444025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-00a96ebd-b217-4f61-a27c-41f7b76328ad tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:21.497485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00a96ebd-b217-4f61-a27c-41f7b76328ad tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:21.504212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-00a96ebd-b217-4f61-a27c-41f7b76328ad tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1095 microversion: 2.1 time: 0.064515 Nov 09 10:41:21.504773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 463/914] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:21 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:21.788338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:21.789704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:21.797279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:21.797716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:21.798490 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:21.798912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:21.876311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8d299493-7d77-47fd-b4f4-7ad3a3d4566e tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 38221 microversion: 2.20 time: 0.092177 Nov 09 10:41:21.876970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 452/915] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:21 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 38221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:22.521250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:22.521988 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:22.529817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:22.530262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:22.531082 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:22.531474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:22.604549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:22.611871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-07ec3ef2-0307-4454-9553-932390b5782b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1193 microversion: 2.1 time: 0.094244 Nov 09 10:41:22.612485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 464/916] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:22 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:22.890766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:22.891675 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:22.902313 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:22.902772 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:22.903558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:22.904004 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:22.980851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-759f312f-0ab5-4f8f-9bed-71a608257817 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 38221 microversion: 2.20 time: 0.094515 Nov 09 10:41:22.985201 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 453/917] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:22 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 38221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:23.629148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:23.629766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:23.637561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:23.638010 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:23.638794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:23.639227 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:23.806498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:23.815008 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5060c9aa-016e-49f9-b7d7-a00c250f75a3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1279 microversion: 2.1 time: 0.189561 Nov 09 10:41:23.815593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 465/918] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:23 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:23.992555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:23.993565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:24.000836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:24.001294 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:24.002081 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:24.002518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:24.069031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-20e862da-be41-4c85-9575-29695a580bcf tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 38221 microversion: 2.20 time: 0.080294 Nov 09 10:41:24.070013 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 454/919] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:23 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 38221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:24.718054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e25faa51-0135-4c1b-9696-2cf0887f388c req-ee2a0058-550c-404d-b177-7b9931536dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770c8a3b-b36d-473c-bf3c-f51f8124875d", "tag": "65d4e176-a65c-4a75-aa8b-00ec55b41da7"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:24.719671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:24.719671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:41:24.731071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e25faa51-0135-4c1b-9696-2cf0887f388c req-ee2a0058-550c-404d-b177-7b9931536dfe service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:24.731071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e25faa51-0135-4c1b-9696-2cf0887f388c req-ee2a0058-550c-404d-b177-7b9931536dfe service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:24.742128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e25faa51-0135-4c1b-9696-2cf0887f388c req-ee2a0058-550c-404d-b177-7b9931536dfe service nova] Creating event network-changed:65d4e176-a65c-4a75-aa8b-00ec55b41da7 for instance 770c8a3b-b36d-473c-bf3c-f51f8124875d on hv-cinder-81662 Nov 09 10:41:24.747698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e25faa51-0135-4c1b-9696-2cf0887f388c req-ee2a0058-550c-404d-b177-7b9931536dfe service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Nov 09 10:41:24.748410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 466/920] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:24.833742 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:24.836586 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:24.842433 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:24.843174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:24.844066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:24.844466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:25.081322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:25.082531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:25.087616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:25.088909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:25.089438 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:25.090300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:25.090813 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:25.095773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-00cc9233-607d-4a10-a311-a54aacf4a931 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.266325 Nov 09 10:41:25.096395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 455/921] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:24 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:25.189506 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d7127f4b-8ff9-460b-b8af-49c0dc37c9a4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 200 len: 38362 microversion: 2.20 time: 0.112066 Nov 09 10:41:25.193685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 467/922] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:25 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 38362 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:41:25.200121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:25.200624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:25.207284 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:25.207686 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:25.208407 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:25.208920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:25.233431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c0d0f937-d1e0-4382-b8a9-cef4d615f22a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/ips" status: 200 len: 151 microversion: 2.20 time: 0.037093 Nov 09 10:41:25.234014 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 456/923] 10.222.0.35 () {60 vars in 1288 bytes} [Tue Nov 9 10:41:25 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:41:26.118143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:26.118746 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:26.126310 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:26.126758 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:26.127720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:26.128071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:26.267558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:26.274901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-130495c9-cd09-4174-ab8c-47a45a8d2312 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.164949 Nov 09 10:41:26.302661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 468/924] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:26 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:27.291806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:27.293040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:27.299542 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:27.300023 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:27.300829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:27.301263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:27.442995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:27.451161 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-dd1b3d2b-0e82-43a3-a41a-b94e11935bb3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.163063 Nov 09 10:41:27.451806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 457/925] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:27 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:27.729027 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:27.729613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:27.735940 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:27.736422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:27.737196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:27.737633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:27.762155 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lazy-loading 'flavor' on Instance uuid dadb4dd5-78ec-40d3-86dd-40160c903665 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:41:28.311825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f8adbcc0-602f-4160-ad77-d5e9feb098d8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 202 len: 0 microversion: 2.20 time: 0.586170 Nov 09 10:41:28.312482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 469/926] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:27 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:41:28.320331 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:28.320944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:28.327217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:28.327668 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:28.328497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:28.328930 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:28.464773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:28.468821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:28.469647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:28.473113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:28.475752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:28.475752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2b47cbcb-5fc9-457e-ba14-00b86113b08c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.159129 Nov 09 10:41:28.476608 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 458/927] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:28 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:28.477859 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:28.478245 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:28.479036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:28.479465 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:28.618394 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:28.626128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aedcb1df-45bc-4346-a249-6ccb4b30380a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.161706 Nov 09 10:41:28.626694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 470/928] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:28 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:29.495392 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:29.496524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:29.502813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:29.503258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:29.504046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:29.504480 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:29.643005 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:29.643525 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:29.643652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:29.650101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:29.650539 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:29.651317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:29.651518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:29.651857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:29.653058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:29.654222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b5450d0a-4489-469f-8c03-ff1bbc9b9c0f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.162893 Nov 09 10:41:29.654981 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 459/929] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:29 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:29.790470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:29.798422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6179def2-ec43-4f58-a746-a4d936d1ee23 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.159055 Nov 09 10:41:29.799189 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 471/930] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:29 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:30.672424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:30.673013 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:30.679280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:30.679721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:30.680520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:30.680947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:30.812179 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:30.815109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:30.815844 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:30.820462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:30.821977 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:30.822454 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:30.822901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:30.823140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-68894452-eced-47be-beb6-0eff6dd93b74 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.154995 Nov 09 10:41:30.823676 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:30.823779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 460/931] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:30 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:30.824143 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:30.954216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:30.961584 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ab0864df-b5ce-4630-82d4-08b239883ceb tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.150394 Nov 09 10:41:30.962147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 472/932] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:30 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:31.841527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:31.842130 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:31.848449 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:31.848889 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:31.849672 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:31.850098 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:31.978493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:31.979106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:31.986290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:31.986504 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:31.986821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:31.987626 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:31.988107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:31.994520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:31.996885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:31.998063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ec395c76-9b3b-4457-85b3-de4754d87112 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.160458 Nov 09 10:41:31.998634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 461/933] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:31 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:32.132960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:32.141000 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5ec1db60-e919-403a-a50d-f09fe0b87a44 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.166091 Nov 09 10:41:32.141602 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 473/934] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:31 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:33.016229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:33.016837 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:33.023234 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:33.023675 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:33.024525 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:33.024962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:33.158302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:33.159013 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:33.164254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:33.165368 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:33.165819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:33.166600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:33.167075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:33.172843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:33.174855 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:33.175725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-eda42d47-1899-42ce-894e-8e15a085967d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.163244 Nov 09 10:41:33.176487 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 462/935] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:33 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:33.300852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:33.308080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-eb3d3c52-fe36-48fd-8a4f-1bc36ea7f88f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.153495 Nov 09 10:41:33.308647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 474/936] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:33 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:34.193971 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:34.195124 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:34.202404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:34.202995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:34.203899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:34.204482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:34.327160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:34.328634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:34.335771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:34.336503 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:34.337541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:34.338141 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:34.353064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:34.361497 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:34.363023 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:34.364250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f7d73765-f203-4f97-bcea-e69d7f56380b tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.173961 Nov 09 10:41:34.368002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 463/937] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:34 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:34.486009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:34.494065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-48b23b6e-c57a-408f-a63a-9633e6b688fa tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.172372 Nov 09 10:41:34.494655 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 475/938] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:34 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:35.382556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:35.383080 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:35.389398 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:35.389850 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:35.390617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:35.391047 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:35.514500 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:35.515135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:35.518874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:35.521582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:35.522031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:35.522803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:35.523230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:35.526641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:35.528998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:35.530862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-045eed34-6978-42a4-ae45-f14ea4d95909 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.151819 Nov 09 10:41:35.531910 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 464/939] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:35 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:35.662179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:35.669802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9149a08c-2325-404b-a613-6a74d6edb5ae tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.158971 Nov 09 10:41:35.670383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 476/940] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:35 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:36.476064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-01436590-3b43-4833-8c25-79b1f26e9e30 req-9555183b-0172-4290-8a1e-8081eb5f8254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770c8a3b-b36d-473c-bf3c-f51f8124875d", "name": "network-vif-plugged", "status": "completed", "tag": "65d4e176-a65c-4a75-aa8b-00ec55b41da7"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:36.476783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:36.476783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:41:36.484410 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-01436590-3b43-4833-8c25-79b1f26e9e30 req-9555183b-0172-4290-8a1e-8081eb5f8254 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.484853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-01436590-3b43-4833-8c25-79b1f26e9e30 req-9555183b-0172-4290-8a1e-8081eb5f8254 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.498454 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-01436590-3b43-4833-8c25-79b1f26e9e30 req-9555183b-0172-4290-8a1e-8081eb5f8254 service nova] Creating event network-vif-plugged:65d4e176-a65c-4a75-aa8b-00ec55b41da7 for instance 770c8a3b-b36d-473c-bf3c-f51f8124875d on hv-cinder-81662 Nov 09 10:41:36.503463 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-01436590-3b43-4833-8c25-79b1f26e9e30 req-9555183b-0172-4290-8a1e-8081eb5f8254 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087397 Nov 09 10:41:36.504310 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 465/941] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:36.522055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1115581956"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:36.523348 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:36.528950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.529399 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.530216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.530884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.554946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:36.555636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:36.563526 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.564030 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.564980 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.565234 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.684357 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.network.security_group_api [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Removing security group 78ee30c7-d063-4cce-8aeb-2473ad541ea4 from port 7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff Nov 09 10:41:36.710166 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:36.718986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:36.720767 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:36.721964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-189d4ce6-0607-4656-9ab5-5551c629ca65 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.171156 Nov 09 10:41:36.722529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 466/942] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:36 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:41:36.727484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:36.728178 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:36.735415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.736164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.737137 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:36.737752 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:36.927509 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:36.936535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d4925262-077e-4141-a7cd-222a2fecae77 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.212556 Nov 09 10:41:36.937238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 467/943] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:36 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:37.154260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-05ca518c-e727-4733-b453-d32e4237e16b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action" status: 202 len: 0 microversion: 2.1 time: 0.637051 Nov 09 10:41:37.154883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 477/944] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:41:36 2021] POST /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:37.271275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-7640bb27-1fd3-401b-94da-cb000325742c req-1a1b1409-8284-4329-b948-f531bf05b131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:37.273474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:37.273474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:41:37.281087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7640bb27-1fd3-401b-94da-cb000325742c req-1a1b1409-8284-4329-b948-f531bf05b131 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:37.281765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7640bb27-1fd3-401b-94da-cb000325742c req-1a1b1409-8284-4329-b948-f531bf05b131 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:37.298970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-7640bb27-1fd3-401b-94da-cb000325742c req-1a1b1409-8284-4329-b948-f531bf05b131 service nova] Creating event network-changed:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:41:37.304142 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-7640bb27-1fd3-401b-94da-cb000325742c req-1a1b1409-8284-4329-b948-f531bf05b131 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144901 Nov 09 10:41:37.308215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 468/945] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:37.745652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:37.746946 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:37.754462 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:37.754905 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:37.755765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:37.756389 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:37.955858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:37.956575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:37.963014 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:37.963459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:37.964259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:37.964745 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:38.012879 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:38.023766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:38.026499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:38.027798 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7a4b7c59-c2e6-4860-acd9-940cbc3a891c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.288371 Nov 09 10:41:38.028558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 478/946] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:37 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:38.120577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:38.129087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c8ddf5c5-4523-4878-bd48-3df72102239b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1267 microversion: 2.1 time: 0.178697 Nov 09 10:41:38.129663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 469/947] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:37 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:38.670630 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:38.671171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:38.678468 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:38.678939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:38.679872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:38.680339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:38.768385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lazy-loading 'services' on Instance uuid 861de895-d655-4b82-b16d-b4f73e9ccba3 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:41:38.975376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-448f00e2-32a3-48ae-86ba-76ff35cb6460 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments/b1f2755d-df4a-4ab3-b614-550f20bf86a5" status: 202 len: 0 microversion: 2.1 time: 0.309332 Nov 09 10:41:38.976040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 479/948] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:41:38 2021] DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments/b1f2755d-df4a-4ab3-b614-550f20bf86a5 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:38.985543 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:38.993717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:38.993717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:38.994125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:38.994689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:38.995382 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.027149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3e2f6068-511a-44ec-8651-cbaa831b1f1e tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Nov 09 10:41:39.027734 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 470/949] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:41:38 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:39.046681 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:39.051252 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:39.053925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.054263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.055055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.055497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.151830 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:39.162330 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:39.167246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.168263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.169356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.170009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.221282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:39.229399 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:39.231033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:39.233230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-72a57d91-97bc-43ca-a42f-e21578b29c1f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1744 microversion: 2.20 time: 0.190340 Nov 09 10:41:39.234107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 480/950] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:39 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:39.319356 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-03b16dea-03e2-4150-87d8-0aee4f6b8ad6 req-6d4a015e-0b3d-43ec-9538-765cc377e55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:39.321328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:39.321328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:41:39.334096 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:39.334346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-03b16dea-03e2-4150-87d8-0aee4f6b8ad6 req-6d4a015e-0b3d-43ec-9538-765cc377e55d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.335070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-03b16dea-03e2-4150-87d8-0aee4f6b8ad6 req-6d4a015e-0b3d-43ec-9538-765cc377e55d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.340965 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-82035fbc-8e1d-4a8e-ae1d-93221591f162 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1453 microversion: 2.1 time: 0.197619 Nov 09 10:41:39.341630 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 471/951] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:39 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:39.350383 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-03b16dea-03e2-4150-87d8-0aee4f6b8ad6 req-6d4a015e-0b3d-43ec-9538-765cc377e55d service nova] Creating event network-changed:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:41:39.356673 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-03b16dea-03e2-4150-87d8-0aee4f6b8ad6 req-6d4a015e-0b3d-43ec-9538-765cc377e55d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041013 Nov 09 10:41:39.357274 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 481/952] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:39.359914 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:39.360477 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:39.366616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.367677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.368667 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:39.369103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:39.849444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:39.857721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-51aff191-8e07-484e-8db5-24b103f386f0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1453 microversion: 2.1 time: 0.503193 Nov 09 10:41:39.858310 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 472/953] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:39 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1453 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:41:40.041082 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:40.042097 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:40.049264 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:40.049720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:40.053018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:40.053018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:40.081949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8d26bdcc-de2f-439d-8fd9-0d55e49862b4 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Nov 09 10:41:40.086541 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 482/954] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:41:40 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:40.252617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:40.253465 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:40.260736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:40.261193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:40.262536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:40.262961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:40.409091 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:40.417545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:40.419146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:40.420571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c810705b-fa01-475d-8612-0a9f944a85a9 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1744 microversion: 2.20 time: 0.171621 Nov 09 10:41:40.421308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 473/955] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:40 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:41.095069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:41.096721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:41.104470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.104954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.106247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.106812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.140532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1f4ff37c-e667-4cc7-a5e1-8e8fa0b3fb7b tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050127 Nov 09 10:41:41.141116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 483/956] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:41:41 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:41:41.151615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:41.152351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:41.158862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.159468 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.160367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.160874 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.273470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] HTTP exception thrown: Instance 861de895-d655-4b82-b16d-b4f73e9ccba3 is not attached to volume b1f2755d-df4a-4ab3-b614-550f20bf86a5 Nov 09 10:41:41.274253 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Returning 404 to user: Instance 861de895-d655-4b82-b16d-b4f73e9ccba3 is not attached to volume b1f2755d-df4a-4ab3-b614-550f20bf86a5 {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:41:41.274986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5fc8b862-3553-4483-830c-9e2a26ca22de tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments/b1f2755d-df4a-4ab3-b614-550f20bf86a5" status: 404 len: 154 microversion: 2.1 time: 0.127348 Nov 09 10:41:41.275626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 474/957] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:41:41 2021] DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3/os-volume_attachments/b1f2755d-df4a-4ab3-b614-550f20bf86a5 => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:41:41.438457 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:41.439228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:41.445299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.445747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.446775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:41.447384 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:41.664296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:41.677075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:41.682661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:41.684900 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d76890b4-f5a7-422f-b43f-2b5ea9758d45 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.249778 Nov 09 10:41:41.688100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 484/958] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:41 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:42.639666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-9f204bce-2e30-49c0-af09-b7e09a5ddf5e req-d24060fe-c659-4482-b302-f91b6adcb58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770c8a3b-b36d-473c-bf3c-f51f8124875d", "tag": "65d4e176-a65c-4a75-aa8b-00ec55b41da7"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:42.642155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:42.642155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:41:42.653347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9f204bce-2e30-49c0-af09-b7e09a5ddf5e req-d24060fe-c659-4482-b302-f91b6adcb58d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:42.654125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-9f204bce-2e30-49c0-af09-b7e09a5ddf5e req-d24060fe-c659-4482-b302-f91b6adcb58d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:42.666941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-9f204bce-2e30-49c0-af09-b7e09a5ddf5e req-d24060fe-c659-4482-b302-f91b6adcb58d service nova] Creating event network-changed:65d4e176-a65c-4a75-aa8b-00ec55b41da7 for instance 770c8a3b-b36d-473c-bf3c-f51f8124875d on hv-cinder-81662 Nov 09 10:41:42.673388 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-9f204bce-2e30-49c0-af09-b7e09a5ddf5e req-d24060fe-c659-4482-b302-f91b6adcb58d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037837 Nov 09 10:41:42.681285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 475/959] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:42.714777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:42.715485 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:42.722958 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:42.725713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:42.727762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:42.728473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:42.757681 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:42.758783 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:42.769626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:42.774144 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:42.789711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:42.790411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:42.827981 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:41:42.925982 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:42.935852 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:42.939120 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:42.940893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4593d4dc-e00c-4fca-8058-5a66034ae950 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.232294 Nov 09 10:41:42.942075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 485/960] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:42 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:43.724484 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f0c9322a-2a1c-400f-92cf-d52ff91a3ced tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 204 len: 0 microversion: 2.1 time: 0.971528 Nov 09 10:41:43.728566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 476/961] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:41:42 2021] DELETE /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:41:43.733914 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:43.735240 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:43.743385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:43.744202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:43.745515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:43.746108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:43.950212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:43.960338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:43.961330 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:43.972532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e36769f8-c81d-4043-894d-e736c4d737cc tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1556 microversion: 2.1 time: 0.242739 Nov 09 10:41:43.973817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 486/962] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:43 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:43.976346 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:43.976807 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:43.977606 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:43.978073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:44.148123 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:44.160461 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:44.163150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:44.164550 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-905fc457-6e2b-4ba3-aa62-d22938a514e2 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.208325 Nov 09 10:41:44.165220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 477/963] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:43 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:41:44.473855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e4217338-3a04-47fc-88f8-8453163eedec req-6211e717-604b-427d-84c0-7eb2ff6334a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "name": "network-vif-plugged", "status": "completed", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:44.473855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:44.473855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:41:44.473855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e4217338-3a04-47fc-88f8-8453163eedec req-6211e717-604b-427d-84c0-7eb2ff6334a2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:44.473855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e4217338-3a04-47fc-88f8-8453163eedec req-6211e717-604b-427d-84c0-7eb2ff6334a2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:44.485790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e4217338-3a04-47fc-88f8-8453163eedec req-6211e717-604b-427d-84c0-7eb2ff6334a2 service nova] Creating event network-vif-plugged:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:41:44.491030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e4217338-3a04-47fc-88f8-8453163eedec req-6211e717-604b-427d-84c0-7eb2ff6334a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029579 Nov 09 10:41:44.491904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 487/964] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:41:44.993758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:44.995275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:45.002989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:45.004178 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:45.005141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:45.005639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:45.154200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:45.161757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5d4b88c9-7f0b-4a2c-95cc-1272cd892f5c tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1556 microversion: 2.1 time: 0.174164 Nov 09 10:41:45.172629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 478/965] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:44 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:45.187118 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:45.187991 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:45.195282 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:45.195960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:45.197253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:45.198157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:45.369278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:45.380607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:45.382268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:45.383467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-00d2ca3f-4a5e-446a-8da6-6386b9ae0478 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.202735 Nov 09 10:41:45.384054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 488/966] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:45 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:46.204189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:46.205800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:46.221456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:46.221456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:46.223315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:46.225036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:46.300200 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-66697454-3d55-4983-8faa-6b3d16d48b00 req-4e4bc19c-c1e3-48cb-9d2a-9c52ca4ddd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861de895-d655-4b82-b16d-b4f73e9ccba3", "name": "network-vif-deleted", "tag": "7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:46.302451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:46.302451 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:41:46.315416 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-66697454-3d55-4983-8faa-6b3d16d48b00 req-4e4bc19c-c1e3-48cb-9d2a-9c52ca4ddd12 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:46.316173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-66697454-3d55-4983-8faa-6b3d16d48b00 req-4e4bc19c-c1e3-48cb-9d2a-9c52ca4ddd12 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:46.336633 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:46.339432 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-66697454-3d55-4983-8faa-6b3d16d48b00 req-4e4bc19c-c1e3-48cb-9d2a-9c52ca4ddd12 service nova] Creating event network-vif-deleted:7be5f27b-8ac9-44ea-8a17-d02b2ed8a2ff for instance 861de895-d655-4b82-b16d-b4f73e9ccba3 on hv-cinder-81662 Nov 09 10:41:46.347054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-66697454-3d55-4983-8faa-6b3d16d48b00 req-4e4bc19c-c1e3-48cb-9d2a-9c52ca4ddd12 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050113 Nov 09 10:41:46.349312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 489/967] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:41:46.353048 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e3138ba6-3614-49b2-8612-7dbc86d34dba tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1514 microversion: 2.1 time: 0.178140 Nov 09 10:41:46.353866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 479/968] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:46 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:46.404737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:46.405796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:46.412511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:46.413416 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:46.414493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:46.415156 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:46.601528 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:46.611278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:46.613663 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:46.616553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3486f4da-b8dc-41c2-bb92-2dfba58c95de tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.216890 Nov 09 10:41:46.616553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 490/969] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:46 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:47.376498 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:47.379139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:47.392016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:47.401771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:47.401771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:47.401771 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:47.450338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:47.450789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:47.451249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lazy-loading 'fault' on Instance uuid 861de895-d655-4b82-b16d-b4f73e9ccba3 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:41:47.500311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1a18d51c574a4e87e9126d8be327ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b538f1548c3549a188cafef15f81b59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:47.508309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c418327c-4898-430c-b338-ed3e47ad1506 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 200 len: 1349 microversion: 2.1 time: 0.139956 Nov 09 10:41:47.518213 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 480/970] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:47 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 1349 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:41:47.634343 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:47.634919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:47.642207 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:47.642655 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:47.643461 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:47.643896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:47.798960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:47.809147 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:47.810692 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:47.811923 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4dcddf49-eb82-4b16-b240-4692e629062c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.181665 Nov 09 10:41:47.812915 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 491/971] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:47 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:48.528593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:48.529832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] [instance: 861de895-d655-4b82-b16d-b4f73e9ccba3] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:48.537044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:48.537491 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:48.538418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:48.539034 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:48.559852 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] HTTP exception thrown: Instance 861de895-d655-4b82-b16d-b4f73e9ccba3 could not be found. Nov 09 10:41:48.560494 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Returning 404 to user: Instance 861de895-d655-4b82-b16d-b4f73e9ccba3 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:41:48.561377 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-61168c73-5a34-4507-a295-cc83c8ccada3 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3" status: 404 len: 111 microversion: 2.1 time: 0.039398 Nov 09 10:41:48.561946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 481/972] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:41:48 2021] GET /compute/v2.1/servers/861de895-d655-4b82-b16d-b4f73e9ccba3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:41:48.570896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b81f350f-14cf-4d42-9ae2-05520a1c1a65 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] Calling method '.version_select at 0x7f53dceed4c0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:48.708908 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b81f350f-14cf-4d42-9ae2-05520a1c1a65 tempest-TestMinimumBasicScenario-1435183954 tempest-TestMinimumBasicScenario-1435183954-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1815529164" status: 202 len: 0 microversion: 2.1 time: 0.141227 Nov 09 10:41:48.720492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 492/973] 10.222.0.35 () {58 vars in 1271 bytes} [Tue Nov 9 10:41:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1815529164 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:41:48.839950 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:48.841241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:48.851482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:48.852115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:48.852999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:48.853647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:49.047760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:49.060104 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:49.062066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:49.063718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d8b055f5-905f-4021-b2cd-d8b4e1301870 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.236037 Nov 09 10:41:49.064511 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 482/974] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:48 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:41:50.093401 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:50.095353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:50.108022 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:50.111345 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:50.111345 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:50.112013 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:50.320334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:50.346029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:50.348153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:50.349700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1469983e-39e5-4cfc-8be0-a36deb3bab16 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.267415 Nov 09 10:41:50.356742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 493/975] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:50 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:51.372073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:51.372683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:51.380877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:51.382848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:51.384453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:51.386633 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:51.522378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:51.533690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:51.535364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:51.536696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6f291e2f-1016-4787-9899-c68134994b2d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.170503 Nov 09 10:41:51.537291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 483/976] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:51 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:52.556750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:52.557634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:52.566839 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:52.567577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:52.568804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:52.573321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:52.722599 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:52.735232 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:52.737081 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:52.738613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b22601e3-6ab3-464f-bad0-3cd61d6d4cf5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1739 microversion: 2.20 time: 0.186861 Nov 09 10:41:52.739666 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 494/977] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:52 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:41:53.756705 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:53.758387 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:53.765361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:53.765811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:53.766685 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:53.767053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:54.012949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:54.028296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:54.032056 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:54.034425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-736ac6ab-e738-4d5a-b69d-bd5f81dbba25 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1721 microversion: 2.20 time: 0.281158 Nov 09 10:41:54.035453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 484/978] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:53 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:55.054419 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:55.055204 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:55.062405 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:55.062857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:55.063694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:55.064178 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:55.211755 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:55.222237 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:55.223776 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:55.225011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bbb25ddb-9024-4aa9-9dbb-011073187aa8 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1721 microversion: 2.20 time: 0.174631 Nov 09 10:41:55.225588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 495/979] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:55 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:56.254891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:56.255596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:56.263539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:56.264103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:56.264886 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:56.265312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:56.413471 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:56.424496 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:56.425984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:56.427198 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b544fd9e-5829-4f11-bbcc-f4d19089324c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1721 microversion: 2.20 time: 0.181447 Nov 09 10:41:56.427761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 485/980] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:56 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:57.446997 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:57.447605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:57.456116 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:57.462104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:57.462104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:57.462104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:57.658766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:57.667995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:57.670125 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:41:57.671894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1c816bd6-234a-4a81-b428-db1148f6dbd7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1664 microversion: 2.20 time: 0.229815 Nov 09 10:41:57.690159 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "036c7343-374c-4587-9e11-9cbf5f8e593b"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:57.691447 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:57.693291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 496/981] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:41:57 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1664 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:41:57.698168 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:57.699616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:57.700968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:57.701616 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:58.428994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-3a1e5ba6-3306-4043-9bdf-8dd8e86147ec req-a7821e7f-0767-4914-a332-623f5b866358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "name": "network-vif-unplugged", "status": "completed", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:58.430877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:41:58.430877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:41:58.438728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-3a1e5ba6-3306-4043-9bdf-8dd8e86147ec req-a7821e7f-0767-4914-a332-623f5b866358 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:58.439171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-3a1e5ba6-3306-4043-9bdf-8dd8e86147ec req-a7821e7f-0767-4914-a332-623f5b866358 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:58.451604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.compute.server_external_events [req-3a1e5ba6-3306-4043-9bdf-8dd8e86147ec req-a7821e7f-0767-4914-a332-623f5b866358 service nova] Unable to find a host for instance dadb4dd5-78ec-40d3-86dd-40160c903665. Dropping event network-vif-unplugged {{(pid=122672) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 09 10:41:58.457649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-3a1e5ba6-3306-4043-9bdf-8dd8e86147ec req-a7821e7f-0767-4914-a332-623f5b866358 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027484 Nov 09 10:41:58.457649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 497/982] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 09 10:41:58.905934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-68eafa34-acc4-4a23-a7aa-f2fa81e58e8a tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.219626 Nov 09 10:41:58.911954 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 486/983] 10.222.0.35 () {62 vars in 1363 bytes} [Tue Nov 9 10:41:57 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments => generated 188 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:41:59.072069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:41:59.072878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:59.080738 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:59.081238 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:59.081956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:59.082595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:59.796910 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5545e9d6-451d-40bf-b254-d836dc1bf1c7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments/036c7343-374c-4587-9e11-9cbf5f8e593b" status: 202 len: 0 microversion: 2.20 time: 0.728804 Nov 09 10:41:59.799564 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 498/984] 10.222.0.35 () {60 vars in 1456 bytes} [Tue Nov 9 10:41:59 2021] DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments/036c7343-374c-4587-9e11-9cbf5f8e593b => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 09 10:41:59.856577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:41:59.857147 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:41:59.863852 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:59.864341 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:41:59.865267 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:41:59.865703 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:00.120626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0fdf5151-5ad9-4dc3-8e3c-56f4b31600e6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action" status: 202 len: 0 microversion: 2.20 time: 0.268375 Nov 09 10:42:00.121324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 487/985] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Nov 9 10:41:59 2021] POST /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:42:00.130890 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:00.131611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:00.140036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:00.140499 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:00.141387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:00.141907 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:00.337954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:00.351715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:00.353378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:00.355721 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8045a99f-13d7-4317-af59-313d8f0eba09 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1672 microversion: 2.20 time: 0.227849 Nov 09 10:42:00.356339 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 499/986] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:00 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:01.384180 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:01.384838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:01.393307 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:01.393866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:01.394795 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:01.395261 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:01.570479 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:01.581637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:01.583452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:01.584684 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6e4205e0-8db7-469a-9e87-bfd834ec45d0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1674 microversion: 2.20 time: 0.207078 Nov 09 10:42:01.585291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 488/987] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:01 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:02.603681 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:02.604540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:02.611335 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:02.611793 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:02.612629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:02.613267 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:02.752960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:02.760938 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:02.762453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:02.763610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-93990e8c-b248-4cf1-850e-58891bf97b8c tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.163712 Nov 09 10:42:02.764225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 500/988] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:02 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:03.782189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:03.782798 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:03.790007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:03.790453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:03.791423 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:03.792187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:03.956072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:03.964642 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:03.966470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:03.967639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f46db6a1-05dd-4811-9aa5-73d8a2e58825 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.189214 Nov 09 10:42:03.968264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 489/989] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:03 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:04.989093 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:04.989730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:04.996385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:04.996843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:04.997627 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:04.998061 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:05.150980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:05.162323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:05.163797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:05.165021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-725cb767-f5bd-45b6-96f3-308a13031ccd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.179682 Nov 09 10:42:05.165815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 501/990] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:04 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:06.188763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:06.190387 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:06.205262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:06.205745 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:06.206570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:06.206998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:06.366181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:06.375109 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:06.376649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:06.377800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-de438e65-3a6b-4066-bf9a-3fd7a1769549 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.198471 Nov 09 10:42:06.378361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 490/991] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:06 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:07.397557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:07.398210 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:07.405230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:07.405679 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:07.406480 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:07.406923 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:07.585205 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:07.594089 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:07.595640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:07.596819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8a236380-41b4-4746-bea8-a58c958b102f tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.203174 Nov 09 10:42:07.597379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 502/992] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:07 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:42:08.615070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:08.615717 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:08.622944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:08.623393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:08.624225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:08.624662 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:08.835849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:08.861488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:08.864768 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:08.891657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-455b20c3-612c-4d94-99b3-c269b994f325 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.255705 Nov 09 10:42:08.891657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 491/993] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:08 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:42:09.887575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:09.888213 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:09.894887 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:09.895337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:09.896177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:09.896610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:10.051753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:10.060882 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:10.062441 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:10.063576 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e64d2008-37eb-46b8-8837-d8c4b7e35cbd tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.180581 Nov 09 10:42:10.064221 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 503/994] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:09 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:42:11.081867 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:11.083305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:11.090965 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:11.091882 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:11.092897 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:11.093710 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:11.260998 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:11.269518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:11.271033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:11.272281 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4edba498-0f44-4852-9b5b-046daeb39422 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.194354 Nov 09 10:42:11.274072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 492/995] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:11 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:12.290724 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:12.291344 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:12.297939 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:12.298422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:12.299263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:12.299710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:12.447809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:12.456456 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:12.457955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:12.459145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-96bb137b-80e0-44fd-9616-025298985b59 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.172094 Nov 09 10:42:12.460161 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 504/996] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:12 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:13.477672 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:13.478318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:13.487528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:13.489851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:13.490150 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:13.492041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:13.660730 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:13.672088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:13.673991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:13.675827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-de03f284-fd72-4e6b-a211-a2bca69bbbe1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.201379 Nov 09 10:42:13.681800 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 493/997] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:13 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:14.694418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:14.695021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:14.705812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:14.706258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:14.707091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:14.707518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:14.883659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:14.896489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:14.897984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:14.900847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-15ed99c7-0656-4950-b674-aa9fbefe3ac0 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.208582 Nov 09 10:42:14.905007 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 505/998] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:14 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:15.919718 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:15.920400 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:15.928096 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:15.928665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:15.929896 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:15.930647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:16.096036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:16.104136 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:16.105747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:16.106908 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-39759533-b5af-4dbf-a3e9-048b7674a9a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.192647 Nov 09 10:42:16.107466 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 494/999] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:15 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:17.125922 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:17.126517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:17.132830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:17.133271 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:17.134050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:17.134479 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:17.284256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:17.292990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:17.294495 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:17.295660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0f7bb5f8-814c-4c18-9f2a-d227d2eac5eb tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.173541 Nov 09 10:42:17.296255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 506/1000] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:17 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:18.314629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:18.315251 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:18.321994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:18.322442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:18.323819 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:18.324285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:18.478120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:18.487171 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:18.488809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:18.490041 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4821b430-bbde-462e-ba7a-dfbaf0b47201 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.179279 Nov 09 10:42:18.490628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 495/1001] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:18 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:19.512270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:19.512877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:19.519446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:19.519884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:19.520687 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:19.521135 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:19.668815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:19.677129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:19.678653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:19.679846 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-33ab3e5c-c573-4bcf-8d97-7de69db91f69 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.172192 Nov 09 10:42:19.680534 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 507/1002] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:19 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:19.962638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:19.963203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:19.969514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:19.969961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:19.970740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:19.971204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:19.994880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lazy-loading 'flavor' on Instance uuid d69b3316-b442-4f7a-b46a-5feb9613b807 {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:42:20.386212 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f7914d48-a3ff-4c66-aa07-56c12b44f65e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "POST /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807/action" status: 202 len: 0 microversion: 2.1 time: 0.426966 Nov 09 10:42:20.386827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 496/1003] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:42:19 2021] POST /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:42:20.396059 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:20.397223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:20.405021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:20.405620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:20.406826 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:20.407417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:20.516488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-ad312203-ef7e-4601-9a0f-fe2571aa7eb1 req-968aee72-8e65-43a0-9a74-2909bf38bdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "name": "network-vif-plugged", "status": "completed", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:20.518088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:42:20.518088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:42:20.529624 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-ad312203-ef7e-4601-9a0f-fe2571aa7eb1 req-968aee72-8e65-43a0-9a74-2909bf38bdb2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:20.530063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-ad312203-ef7e-4601-9a0f-fe2571aa7eb1 req-968aee72-8e65-43a0-9a74-2909bf38bdb2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:20.542987 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-ad312203-ef7e-4601-9a0f-fe2571aa7eb1 req-968aee72-8e65-43a0-9a74-2909bf38bdb2 service nova] Creating event network-vif-plugged:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:42:20.549552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-ad312203-ef7e-4601-9a0f-fe2571aa7eb1 req-968aee72-8e65-43a0-9a74-2909bf38bdb2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Nov 09 10:42:20.550160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 497/1004] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:42:20.560864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:20.568965 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7be28e42-37b9-406a-aaff-96300b218527 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.177301 Nov 09 10:42:20.569816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 508/1005] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:20 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:42:20.699755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:20.700623 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:20.707536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:20.708022 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:20.708817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:20.709259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:20.862431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:20.871432 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:20.874593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:20.874593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4bd1333f-c066-4f69-ad81-83ead4426da4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.179584 Nov 09 10:42:20.874937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 498/1006] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:20 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:21.590089 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:21.590742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:21.597842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:21.598298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:21.599108 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:21.599547 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:21.743257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:21.751849 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1bd55439-1de3-42fb-9a87-bdb4eff54b23 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.166430 Nov 09 10:42:21.752464 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 509/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:21 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:21.892638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:21.893192 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:21.900025 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:21.900503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:21.901798 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:21.902226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:22.055789 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:22.065404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:22.067044 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:22.068407 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d4dc4786-f89c-4632-83c8-e7e0b39926b4 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.179585 Nov 09 10:42:22.068989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 499/1008] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:21 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:22.769422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:22.770221 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:22.779433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:22.779819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:22.780955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:22.781909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:22.956134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:22.968308 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9f8c583a-3504-4388-b34a-c0adabea7059 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.202378 Nov 09 10:42:22.969230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 510/1009] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:22 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:23.089509 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:23.090683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:23.101551 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:23.102363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:23.103904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:23.105243 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:23.287319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:23.296926 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:23.298709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:23.299919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e53a943c-33df-47ce-b7dc-f64424c6eec1 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1730 microversion: 2.20 time: 0.217027 Nov 09 10:42:23.300561 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 500/1010] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:23 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:23.986847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:23.987767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:23.996060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:23.996628 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:23.997524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:23.998140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:24.154928 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:24.162678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ca541aa2-47ec-429c-8920-0444814a6054 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.179987 Nov 09 10:42:24.163250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 511/1011] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:23 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:24.318761 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:24.319652 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:24.327535 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:24.328002 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:24.328810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:24.329245 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:24.473700 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:24.482743 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:24.484301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:24.485510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-33f0568a-3700-4a0e-8adb-0c10ee000ec5 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1717 microversion: 2.20 time: 0.170732 Nov 09 10:42:24.486284 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 501/1012] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:24 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 09 10:42:25.180708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:25.181437 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:25.188284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:25.188741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:25.189559 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:25.189994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:25.360514 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:25.368821 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e5a2c2c0-7993-4ae5-bce9-8ca6b8a9ee45 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.192464 Nov 09 10:42:25.369704 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 512/1013] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:25 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:26.388127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:26.388836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:26.403739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:26.404223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:26.405054 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:26.405483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:26.558514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:26.566841 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-dec07b9f-2df6-4cff-88ad-dd5d225ee2c8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.183252 Nov 09 10:42:26.567426 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 502/1014] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:26 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:27.593009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:27.593850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:27.600819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:27.601260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:27.602046 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:27.602476 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:27.758474 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:27.766317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-47447b5b-7950-45e7-a81e-221667c6e10d tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.176913 Nov 09 10:42:27.766909 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 513/1015] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:27 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:28.784700 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:28.785317 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:28.792166 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:28.792610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:28.793411 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:28.793843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:28.946071 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:28.953885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-aa796304-9b1d-4691-b7d7-cd23a27b2264 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.172830 Nov 09 10:42:28.954475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 503/1016] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:28 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:29.971296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:29.971842 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:29.977792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:29.978231 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:29.979045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:29.979489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:30.133644 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:30.142138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f7a2bef5-4a41-49b8-b010-802223060c36 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.174681 Nov 09 10:42:30.142756 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 514/1017] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:29 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:31.160940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:31.161650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:31.168711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:31.169397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:31.170319 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:31.170858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:31.332524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:31.341646 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-78d57256-a0d2-4fa8-b9dd-d069c85bff62 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.184346 Nov 09 10:42:31.342239 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 504/1018] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:31 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:32.359193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:32.359803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:32.366148 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:32.366594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:32.367370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:32.367830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:32.499647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:32.507247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-20456686-78ae-43c6-bb61-0b7af0cdc893 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.151723 Nov 09 10:42:32.507824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 515/1019] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:32 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:33.524308 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:33.524813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:33.531725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:33.532206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:33.533080 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:33.533453 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:33.672994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:33.681560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bb4f9a86-2b0d-4129-8740-038f36911335 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.160314 Nov 09 10:42:33.681560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 505/1020] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:33 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:34.697781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:34.698403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:34.704912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:34.705358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:34.706173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:34.706610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:35.092574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:35.099778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b67f035e-1d1a-45a9-b2cb-22b9c68bfa4c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1511 microversion: 2.1 time: 0.405643 Nov 09 10:42:35.100391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 516/1021] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:34 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:35.115986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:35.116650 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:35.123032 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:35.123470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:35.124262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:35.124688 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:35.340840 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3dc2f0d5-314c-44c0-bb46-b471d3375c7e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "POST /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807/action" status: 202 len: 0 microversion: 2.1 time: 0.228153 Nov 09 10:42:35.341413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 506/1022] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:42:35 2021] POST /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:42:35.349728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:35.350351 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:35.356428 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:35.356878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:35.357659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:35.358095 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:35.493330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:35.501774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-eebe50c4-2b52-4983-992c-6732d696501b tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1519 microversion: 2.1 time: 0.155916 Nov 09 10:42:35.508744 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 517/1023] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:35 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:36.511451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-5b1ddbb1-fed5-442e-9555-e428e559da5f req-5b361e5e-e281-4267-9a16-061dc652de3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "name": "network-vif-unplugged", "status": "completed", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:36.513227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:42:36.513227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:42:36.522471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:36.522471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:36.523046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-5b1ddbb1-fed5-442e-9555-e428e559da5f req-5b361e5e-e281-4267-9a16-061dc652de3d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:36.523046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-5b1ddbb1-fed5-442e-9555-e428e559da5f req-5b361e5e-e281-4267-9a16-061dc652de3d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:36.526230 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:36.526682 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:36.527458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:36.527891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:36.534031 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.compute.server_external_events [req-5b1ddbb1-fed5-442e-9555-e428e559da5f req-5b361e5e-e281-4267-9a16-061dc652de3d service nova] Unable to find a host for instance d69b3316-b442-4f7a-b46a-5feb9613b807. Dropping event network-vif-unplugged {{(pid=122673) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 09 10:42:36.534984 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-5b1ddbb1-fed5-442e-9555-e428e559da5f req-5b361e5e-e281-4267-9a16-061dc652de3d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027419 Nov 09 10:42:36.535652 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 507/1024] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:42:36 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 09 10:42:36.665002 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:36.672929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1f82a018-602e-4ee5-b5a1-fa8d897e15e2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1521 microversion: 2.1 time: 0.157387 Nov 09 10:42:36.673493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 518/1025] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:36 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:42:37.693098 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:37.694216 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:37.703473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:37.703916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:37.704732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:37.705164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:37.842338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:37.850346 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4646a1d2-06ab-4ea1-9201-edc370607254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.162815 Nov 09 10:42:37.850937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 508/1026] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:37 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:38.867701 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:38.868367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:38.875492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:38.875942 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:38.876734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:38.877167 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:39.008564 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:39.016109 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e8fc6f6f-0a2c-4774-83b8-7201f36ec1bb tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.152050 Nov 09 10:42:39.016678 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 519/1027] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:38 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:42:40.032824 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:40.033412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:40.039371 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:40.039812 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:40.040596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:40.041025 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:40.189705 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:40.197318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4b8f54bb-2c49-4b8f-b7f2-90b790f68177 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.168297 Nov 09 10:42:40.197881 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 509/1028] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:40 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:41.214250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:41.214845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:41.221812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:41.222255 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:41.223162 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:41.223591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:41.360705 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:41.369092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1da1fddc-3201-4c62-9c63-0da709d9bade tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.158189 Nov 09 10:42:41.369670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 520/1029] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:41 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:42.385549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:42.386155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:42.392469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:42.392913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:42.393683 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:42.394113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:42.525544 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:42.532936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-73ead356-bbf5-4607-9cbf-ffbfe941d046 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.151058 Nov 09 10:42:42.533502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 510/1030] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:42 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:43.549284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:43.549906 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:43.556665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:43.557113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:43.557893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:43.558329 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:43.695533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:43.703023 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-963b7790-49d9-4afb-9ec9-1d6f26089c58 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.157515 Nov 09 10:42:43.703595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 521/1031] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:43 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:44.720746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:44.721353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:44.727707 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:44.728189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:44.728957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:44.729389 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:44.866125 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:44.873834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8abbdb31-b4de-456f-95c2-3c7aac67ad16 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.156804 Nov 09 10:42:44.874419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 511/1032] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:44 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:45.891449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:45.892083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:45.898795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:45.899298 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:45.900126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:45.900557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:46.035507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:46.043195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b15a3a71-3e43-4742-a715-d94d35282c1c tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.156194 Nov 09 10:42:46.044293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 522/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:45 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:47.061052 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:47.061941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:47.068039 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:47.068562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:47.069359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:47.069793 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:47.207778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:47.215682 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6f973817-1911-46ca-91fb-1f20dcf673df tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.158398 Nov 09 10:42:47.216245 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 512/1034] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:47 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:48.233544 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:48.234211 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:48.243100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:48.243925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:48.244884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:48.245318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:48.381398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:48.389411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-81251ccd-2aee-4757-ad0d-ed011b08f721 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.160623 Nov 09 10:42:48.389988 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 523/1035] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:48 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:48.620265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-b9c851b3-8129-460e-bfb2-b9da670295fc req-852ca047-9484-4d4c-b276-ae9e443762fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "name": "network-vif-plugged", "status": "completed", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:48.622357 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:42:48.622357 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:42:48.628961 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-b9c851b3-8129-460e-bfb2-b9da670295fc req-852ca047-9484-4d4c-b276-ae9e443762fb service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:48.629401 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-b9c851b3-8129-460e-bfb2-b9da670295fc req-852ca047-9484-4d4c-b276-ae9e443762fb service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:48.640618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-b9c851b3-8129-460e-bfb2-b9da670295fc req-852ca047-9484-4d4c-b276-ae9e443762fb service nova] Creating event network-vif-plugged:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:42:48.645904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-b9c851b3-8129-460e-bfb2-b9da670295fc req-852ca047-9484-4d4c-b276-ae9e443762fb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029498 Nov 09 10:42:48.646512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 513/1036] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:42:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:42:49.406397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:49.406986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:49.413295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:49.413739 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:49.414501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:49.414929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:49.550545 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:49.557903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-74b0377a-ae40-4373-b5ba-f7ed223e2254 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1577 microversion: 2.1 time: 0.155379 Nov 09 10:42:49.558466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 524/1037] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:49 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:50.575456 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:50.576189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:50.582415 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:50.582863 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:50.583637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:50.584120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:50.719594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:50.727075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0891d4bc-be85-43ab-9522-f0d53579d76f tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1564 microversion: 2.1 time: 0.156097 Nov 09 10:42:50.727638 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 514/1038] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:50 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:53.497420 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:53.498424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:53.505000 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.505444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:53.506229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.506656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:53.536145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4c27f1c6-2b4e-4233-8695-6270703352be tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043147 Nov 09 10:42:53.536617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 525/1039] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Nov 9 10:42:53 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:42:53.592113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:53.592727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:53.598914 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.599361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:53.600181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.600611 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:53.625829 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Going to try to terminate instance {{(pid=122673) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:42:53.905237 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f05625ab-be5a-44fa-9fd6-2c9469eb3a39 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 204 len: 0 microversion: 2.20 time: 0.316388 Nov 09 10:42:53.905992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 515/1040] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Nov 9 10:42:53 2021] DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 09 10:42:53.914289 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:53.914891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:53.921393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.921833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:53.922603 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:53.923117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:54.054261 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:54.061978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:54.063562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:54.064709 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b7e6c8d4-779e-4513-bce2-fab86436e566 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.154360 Nov 09 10:42:54.065262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 526/1041] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:53 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:55.083164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:55.083866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:55.090305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:55.090757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:55.091540 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:55.091992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:55.227154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:55.235568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:55.237114 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:55.238290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-df79b9e5-949c-45fd-9721-f39ecc4dd4a7 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1723 microversion: 2.20 time: 0.159243 Nov 09 10:42:55.238849 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 516/1042] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:55 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:56.258841 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:56.259491 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:56.267865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:56.268312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:56.269095 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:56.269941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:56.304928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-bac7f40e-ea53-46f1-9419-a00f3ab847a7 req-2bc6e972-d2f7-4aad-be87-b4352c244a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb4dd5-78ec-40d3-86dd-40160c903665", "name": "network-vif-deleted", "tag": "4ec27da7-2521-45f7-b283-ec70efcfae32"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:42:56.306223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:42:56.306223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:42:56.314253 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-bac7f40e-ea53-46f1-9419-a00f3ab847a7 req-2bc6e972-d2f7-4aad-be87-b4352c244a04 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:56.315517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-bac7f40e-ea53-46f1-9419-a00f3ab847a7 req-2bc6e972-d2f7-4aad-be87-b4352c244a04 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:56.326557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-bac7f40e-ea53-46f1-9419-a00f3ab847a7 req-2bc6e972-d2f7-4aad-be87-b4352c244a04 service nova] Creating event network-vif-deleted:4ec27da7-2521-45f7-b283-ec70efcfae32 for instance dadb4dd5-78ec-40d3-86dd-40160c903665 on hv-cinder-81662 Nov 09 10:42:56.335676 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-bac7f40e-ea53-46f1-9419-a00f3ab847a7 req-2bc6e972-d2f7-4aad-be87-b4352c244a04 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Nov 09 10:42:56.339414 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 517/1043] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:42:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:42:56.351586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:56.361224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:56.363904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f48729a25856428f89bca0298d9d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cd90823f43e4d41be05683e40b3ac62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:42:56.375765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dd208f24-de14-4450-b978-3e6fd6e175c6 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 200 len: 1655 microversion: 2.20 time: 0.110599 Nov 09 10:42:56.376421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 527/1044] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:56 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 1655 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 09 10:42:57.388230 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:57.388933 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:57.395581 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:57.396069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:57.396856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:57.397292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:57.413146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. Nov 09 10:42:57.413813 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:42:57.414612 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5423210b-6da4-4804-a9d6-0fe2a9b0c269 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 404 len: 111 microversion: 2.20 time: 0.031530 Nov 09 10:42:57.416120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 518/1045] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Nov 9 10:42:57 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 09 10:42:57.423988 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ac3b1fc3-1786-4f35-acbe-09634e49f07d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '.version_select at 0x7f53dce62ee0>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:57.569661 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ac3b1fc3-1786-4f35-acbe-09634e49f07d tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530813711" status: 204 len: 0 microversion: 2.20 time: 0.149486 Nov 09 10:42:57.570153 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 528/1046] 10.222.0.35 () {60 vars in 1261 bytes} [Tue Nov 9 10:42:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530813711 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 09 10:42:59.664533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:59.665058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:59.671565 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:59.672037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:59.672827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:59.673264 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:59.687488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. Nov 09 10:42:59.688529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:42:59.689376 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1bdc7836-6b34-41ab-b241-511084136b31 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 404 len: 111 microversion: 2.1 time: 0.028573 Nov 09 10:42:59.689941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 519/1047] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:42:59 2021] DELETE /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:42:59.698435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:42:59.699054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: dadb4dd5-78ec-40d3-86dd-40160c903665] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:42:59.706519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:59.706973 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:59.707772 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:42:59.708235 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:42:59.722575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. Nov 09 10:42:59.723173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance dadb4dd5-78ec-40d3-86dd-40160c903665 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:42:59.724035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6b625210-b0b6-45b6-81fc-b354f12a0399 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665" status: 404 len: 111 microversion: 2.1 time: 0.029811 Nov 09 10:42:59.724591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 529/1048] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:42:59 2021] GET /compute/v2.1/servers/dadb4dd5-78ec-40d3-86dd-40160c903665 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:43:00.982663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:00.983309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:00.989804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:00.990251 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:00.991010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:00.991435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:01.005327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. Nov 09 10:43:01.005956 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:43:01.006758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7aa14792-ceaf-4d67-9bd1-84cb3e0cbc80 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 404 len: 111 microversion: 2.1 time: 0.027785 Nov 09 10:43:01.007289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 520/1049] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:43:00 2021] DELETE /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:43:01.015820 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:01.016578 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] [instance: e13b163e-1659-4e4c-ba93-9b4c0b05a6f8] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:01.022815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:01.023264 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:01.024069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:01.024507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:01.038341 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] HTTP exception thrown: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. Nov 09 10:43:01.038972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] Returning 404 to user: Instance e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:43:01.039807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-2d2a9354-702c-448d-88e7-f0c649a2a886 tempest-AttachVolumeShelveTestJSON-1879513217 tempest-AttachVolumeShelveTestJSON-1879513217-project] 10.222.0.35 "GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8" status: 404 len: 111 microversion: 2.1 time: 0.028403 Nov 09 10:43:01.040400 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 530/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:01 2021] GET /compute/v2.1/servers/e13b163e-1659-4e4c-ba93-9b4c0b05a6f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:43:12.448790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: .version_select at 0x7f53dcd90ca0>, body: {"keypair": {"name": "tempest-keypair-163991950"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:12.471657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:43:12.476475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:43:12.978493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:43:12.982806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:43:12.995661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-5e09fb3c-70e4-47c1-a572-b7bd9e1cb5ca tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.689723 Nov 09 10:43:12.996324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 521/1051] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Nov 9 10:43:12 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:15.445385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-31762965", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "230c91f7-84e9-4100-91e5-845eeb203ee8"}], "security_groups": [{"name": "tempest-securitygroup--1642612414"}], "key_name": "tempest-keypair-163991950", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:15.555170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] validate_networks() for [('230c91f7-84e9-4100-91e5-845eeb203ee8', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:43:15.986531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:43:15.986955 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:43:15.987422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:43:15.987824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:43:15.988296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:43:15.997846 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:15.998285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:15.999293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:15.999551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:16.016596 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:43:16.021045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:43:16.032904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:43:16.035352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:43:16.163843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-212b585d-fa8a-4650-acd8-4a2cb0430e93 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722607 Nov 09 10:43:16.168524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 531/1052] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:43:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:43:16.179736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c01c2952-877f-4dc0-8445-a86a8faeb2f7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:16.180559 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c01c2952-877f-4dc0-8445-a86a8faeb2f7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:16.240347 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c01c2952-877f-4dc0-8445-a86a8faeb2f7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:16.273358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c01c2952-877f-4dc0-8445-a86a8faeb2f7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1235 microversion: 2.1 time: 0.099352 Nov 09 10:43:16.284811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 522/1053] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:16 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1235 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:43:17.293737 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-097be414-dbf3-4433-81cd-9ee66e792cfd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:17.295157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-097be414-dbf3-4433-81cd-9ee66e792cfd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:17.349792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-097be414-dbf3-4433-81cd-9ee66e792cfd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:17.357607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-097be414-dbf3-4433-81cd-9ee66e792cfd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1235 microversion: 2.1 time: 0.068672 Nov 09 10:43:17.358168 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 532/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:17 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:18.375575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:18.376338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:18.382678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:18.383114 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:18.383904 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:18.384356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:18.446648 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:18.454121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e354f7fa-e72e-4db9-812c-958d89c097e6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1287 microversion: 2.1 time: 0.083112 Nov 09 10:43:18.454696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 523/1055] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:18 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:19.470574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:19.471260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:19.477657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:19.479216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:19.479216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:19.479989 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:19.623901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:19.631610 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e96bc9e6-d0a5-4e33-a905-17ec8435b3a9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.164784 Nov 09 10:43:19.632511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 533/1056] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:19 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:20.275107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-3979a253-48a8-4ab7-822b-98d80bdced1c req-bb2e96cc-1499-4442-a7f5-b02708b7da47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79e42b6-2d89-4922-9eff-c5e72f4b44fb", "tag": "d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:20.277572 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:43:20.277572 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:43:20.293378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-3979a253-48a8-4ab7-822b-98d80bdced1c req-bb2e96cc-1499-4442-a7f5-b02708b7da47 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:20.294026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-3979a253-48a8-4ab7-822b-98d80bdced1c req-bb2e96cc-1499-4442-a7f5-b02708b7da47 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:20.308349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-3979a253-48a8-4ab7-822b-98d80bdced1c req-bb2e96cc-1499-4442-a7f5-b02708b7da47 service nova] Creating event network-changed:d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610 for instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb on hv-cinder-81662 Nov 09 10:43:20.314141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-3979a253-48a8-4ab7-822b-98d80bdced1c req-bb2e96cc-1499-4442-a7f5-b02708b7da47 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043041 Nov 09 10:43:20.315202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 524/1057] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:43:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:20.648716 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:20.649406 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:20.656633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:20.658527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:20.658527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:20.658527 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:20.795956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:20.803350 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bfedc81f-bb5e-4202-b4b5-bfd91cdfff8d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.158347 Nov 09 10:43:20.803957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 534/1058] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:20 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:21.821253 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:21.821940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:21.829012 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:21.829460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:21.830223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:21.830647 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:21.963865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:21.971363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e6cdd10d-8a7e-490f-9eb3-83469ef58d3f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.154645 Nov 09 10:43:21.971940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 525/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:21 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:22.988060 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:22.988667 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:22.995202 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:22.995646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:22.996449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:22.996878 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:23.128274 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:23.135483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4e562f1b-b684-4a2c-bba2-8ce52430e040 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.151079 Nov 09 10:43:23.136078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 535/1060] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:22 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:24.152801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:24.153435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:24.163951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:24.164412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:24.165233 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:24.165658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:24.306473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:24.314751 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f4223202-bcf7-4915-ad24-f92b677a42f1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.165489 Nov 09 10:43:24.315335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 526/1061] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:24 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:25.330460 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:25.331068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:25.337519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:25.337966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:25.338765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:25.339199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:25.476259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:25.484293 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-88dc9674-59f3-4842-b2ca-b6adbd67bca4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.157394 Nov 09 10:43:25.484862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 536/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:25 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:26.502452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:26.503076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:26.509662 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:26.510111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:26.510885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:26.511921 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:26.644756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:26.651994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-64a40f91-0e52-453f-adeb-6fae964ad348 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.153404 Nov 09 10:43:26.652571 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 527/1063] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:26 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:26.952818 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-df3a1ff7-ca09-49c9-b3ce-94e855e36657 req-199a30b5-081f-45c5-bca6-e75571e399ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79e42b6-2d89-4922-9eff-c5e72f4b44fb", "name": "network-vif-plugged", "status": "completed", "tag": "d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:26.955732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:43:26.955732 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:43:26.961446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-df3a1ff7-ca09-49c9-b3ce-94e855e36657 req-199a30b5-081f-45c5-bca6-e75571e399ec service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:26.961876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-df3a1ff7-ca09-49c9-b3ce-94e855e36657 req-199a30b5-081f-45c5-bca6-e75571e399ec service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:26.973040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-df3a1ff7-ca09-49c9-b3ce-94e855e36657 req-199a30b5-081f-45c5-bca6-e75571e399ec service nova] Creating event network-vif-plugged:d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610 for instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb on hv-cinder-81662 Nov 09 10:43:26.978314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-df3a1ff7-ca09-49c9-b3ce-94e855e36657 req-199a30b5-081f-45c5-bca6-e75571e399ec service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029407 Nov 09 10:43:26.978964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 537/1064] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:43:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:27.668711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:27.669323 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:27.676309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:27.676757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:27.677539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:27.677968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:27.815292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:27.823155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4835ce31-db29-4e54-af58-9dc7bbcf117c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1361 microversion: 2.1 time: 0.157999 Nov 09 10:43:27.824351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 528/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:27 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:43:28.841531 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:28.842260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:28.848418 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:28.848860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:28.849631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:28.850052 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:28.984580 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:28.992009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-58aaf513-00ea-4dbc-9101-ffd2032d0f1e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1547 microversion: 2.1 time: 0.155362 Nov 09 10:43:28.992575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 538/1066] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:28 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:29.008420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:29.008962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:29.015706 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:29.016191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:29.016970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:29.017403 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:29.101113 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-68107a2c-689a-4610-9db0-270673f6e6b6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096349 Nov 09 10:43:29.101711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 529/1067] 10.222.0.35 () {58 vars in 1274 bytes} [Tue Nov 9 10:43:29 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:30.774229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:30.775876 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:30.781568 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-7a832aca-9dcb-4aba-acc6-20fd20b35b4b req-6171c48d-29b5-4be6-bd2e-3af1fe583c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79e42b6-2d89-4922-9eff-c5e72f4b44fb", "tag": "d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:30.784721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:43:30.784721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:43:30.798626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7a832aca-9dcb-4aba-acc6-20fd20b35b4b req-6171c48d-29b5-4be6-bd2e-3af1fe583c99 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:30.799289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-7a832aca-9dcb-4aba-acc6-20fd20b35b4b req-6171c48d-29b5-4be6-bd2e-3af1fe583c99 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:30.801489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:30.801941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:30.802792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:30.803233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:30.828594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-7a832aca-9dcb-4aba-acc6-20fd20b35b4b req-6171c48d-29b5-4be6-bd2e-3af1fe583c99 service nova] Creating event network-changed:d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610 for instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb on hv-cinder-81662 Nov 09 10:43:30.834699 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-7a832aca-9dcb-4aba-acc6-20fd20b35b4b req-6171c48d-29b5-4be6-bd2e-3af1fe583c99 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075436 Nov 09 10:43:30.835938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 530/1068] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:43:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:30.880911 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-73e63777-ff93-4d38-ad26-6c909f569952 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.125844 Nov 09 10:43:30.884316 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 539/1069] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:30 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:31.894602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:31.894999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:31.901476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:31.914208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:31.914208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:31.914208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:31.962801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0c040827-459d-4e11-b5c2-966feca49406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.074167 Nov 09 10:43:31.963603 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 531/1070] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:31 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:32.973983 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:32.974978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:32.982557 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:32.983009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:32.983804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:32.984272 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:33.042195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d3580448-e07f-4b23-a06b-de3e5c87bd61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.072289 Nov 09 10:43:33.043498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 540/1071] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:32 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:34.054238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:34.055225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:34.062677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:34.063119 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:34.063901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:34.064353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:34.121435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f0d65071-54a7-49c0-a1e6-db3f178fbd42 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.070477 Nov 09 10:43:34.122029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 532/1072] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:34 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:35.132727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:35.133720 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:35.140613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:35.141065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:35.141848 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:35.142286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:35.197150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a5eeb9b7-2834-43bc-ab35-a8476c16b91b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.068319 Nov 09 10:43:35.197758 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 541/1073] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:35 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:36.208463 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:36.209448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:36.216275 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:36.216716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:36.217482 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:36.217912 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:36.274653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1e3361ed-326b-4916-970e-f89c26836bd0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.070085 Nov 09 10:43:36.275504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 533/1074] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:36 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:37.285970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:37.286971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:37.294414 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:37.294861 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:37.295636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:37.296168 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:37.355586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-80a2f44c-433c-4225-a379-b8ecc7aa3a92 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.073039 Nov 09 10:43:37.356408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 542/1075] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:37 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:38.367097 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:38.368380 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:38.375712 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:38.376193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:38.376957 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:38.377386 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:38.434722 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2437ee3c-442f-48a8-becc-4c204935be21 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.071587 Nov 09 10:43:38.435332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 534/1076] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:38 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:43:39.446171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:39.447162 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:39.454604 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:39.455101 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:39.455932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:39.456395 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:39.516501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-746ad43a-0475-4a5f-822c-1d9af7a07a66 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 14 microversion: 2.1 time: 0.074140 Nov 09 10:43:39.517134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 543/1077] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:39 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:43:40.527329 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:40.528335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:40.536539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:40.536539 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:40.537007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:40.537434 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:40.613122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-aad5e86d-1f8a-4959-8412-bca1587daded tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 7938 microversion: 2.1 time: 0.089742 Nov 09 10:43:40.613756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 535/1078] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:40 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 7938 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:40.704446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:40.705057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:40.712233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:40.712763 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:40.713520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:40.713949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:40.738773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:43:41.006639 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-71ce7d08-71f9-456a-a32d-6cd2d8df2e10 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "DELETE /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 204 len: 0 microversion: 2.1 time: 0.306555 Nov 09 10:43:41.007226 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 544/1079] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:43:40 2021] DELETE /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:43:41.016506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:41.017203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:41.023960 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:41.024436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:41.025202 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:41.025631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:41.165843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:41.174085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-8f910ebc-e112-4be1-b52f-8669a229ee12 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1577 microversion: 2.1 time: 0.162512 Nov 09 10:43:41.174660 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 536/1080] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:41 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:41.625950 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:41.626986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:41.634082 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:41.634536 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:41.635318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:41.635754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:41.708100 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-71e36026-f4cc-4693-a04e-1e01571cb7f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 15146 microversion: 2.1 time: 0.086686 Nov 09 10:43:41.708747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 545/1081] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:41 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 15146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:42.191566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:42.192220 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:42.199916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:42.200442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:42.201256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:42.201701 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:42.349666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:42.357335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-60e62ed5-795e-405f-9b4c-2472cc3085f8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1577 microversion: 2.1 time: 0.169751 Nov 09 10:43:42.357916 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 537/1082] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:42 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:42.719649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:42.720941 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:42.728007 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:42.728466 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:42.729262 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:42.729695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:42.805448 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-738ec99c-ba67-499f-817c-51ef8b8499ab tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 18305 microversion: 2.1 time: 0.089931 Nov 09 10:43:42.806094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 546/1083] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:42 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 18305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:43.377462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:43.379129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:43.384885 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:43.385420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:43.386193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:43.386711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:43.459457 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:43.467856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-bb11dbe3-caef-41f1-8523-df070063193f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1509 microversion: 2.1 time: 0.094154 Nov 09 10:43:43.468478 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 538/1084] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:43 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:43:43.576959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-69e4a758-b388-4954-9a8e-7f22ee502230 req-910eb50b-b6ad-475b-8f94-bc07e73348e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770c8a3b-b36d-473c-bf3c-f51f8124875d", "name": "network-vif-deleted", "tag": "65d4e176-a65c-4a75-aa8b-00ec55b41da7"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:43.579520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:43:43.579520 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:43:43.589595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-69e4a758-b388-4954-9a8e-7f22ee502230 req-910eb50b-b6ad-475b-8f94-bc07e73348e6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:43.590044 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-69e4a758-b388-4954-9a8e-7f22ee502230 req-910eb50b-b6ad-475b-8f94-bc07e73348e6 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:43.604270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-69e4a758-b388-4954-9a8e-7f22ee502230 req-910eb50b-b6ad-475b-8f94-bc07e73348e6 service nova] Creating event network-vif-deleted:65d4e176-a65c-4a75-aa8b-00ec55b41da7 for instance 770c8a3b-b36d-473c-bf3c-f51f8124875d on hv-cinder-81662 Nov 09 10:43:43.611494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-69e4a758-b388-4954-9a8e-7f22ee502230 req-910eb50b-b6ad-475b-8f94-bc07e73348e6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Nov 09 10:43:43.612475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 547/1085] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:43.818570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:43.819615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:43.827069 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:43.827517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:43.828419 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:43.828861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:43.909549 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-593aed92-2329-41b4-98a6-e338828cac01 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 19342 microversion: 2.1 time: 0.094531 Nov 09 10:43:43.910119 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 539/1086] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:43 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 19342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:44.490984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:44.490984 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:44.495158 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:44.495713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:44.496585 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:44.497507 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:44.533438 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:44.533891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:44.534346 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lazy-loading 'fault' on Instance uuid 770c8a3b-b36d-473c-bf3c-f51f8124875d {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:43:44.594353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:44.594353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cfedd5ac-57a3-4a4b-8e1c-13e04fa76fe8 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 200 len: 1231 microversion: 2.1 time: 0.101994 Nov 09 10:43:44.594353 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 548/1087] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:44 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:44.922859 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:44.923858 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:44.930975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:44.937877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:44.937877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:44.937877 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:45.006704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-800d9b1a-9f66-4641-ae99-5aaf93da59f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 22119 microversion: 2.1 time: 0.088624 Nov 09 10:43:45.007349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 540/1088] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:44 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 22119 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:45.600929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:45.601548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:45.607925 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:45.608404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:45.609191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:45.609625 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:45.623929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] HTTP exception thrown: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. Nov 09 10:43:45.628548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Returning 404 to user: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:43:45.628548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1cbcd960-438c-4ce7-b54a-d557f77bcb99 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 404 len: 111 microversion: 2.1 time: 0.028399 Nov 09 10:43:45.628548 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 549/1089] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:45 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:43:45.723358 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-684532720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262482173", "security_groups": [{"name": "tempest-secgroup-smoke-1418179760"}], "block_device_mapping_v2": [{"uuid": "c88e71b3-9b08-41b4-a885-6a0e8a163a31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9ec3b3d-16d6-42bb-8661-ba5a7b86073a"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:45.836063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] validate_networks() for [('d9ec3b3d-16d6-42bb-8661-ba5a7b86073a', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:43:46.018990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:46.020183 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:46.026382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:46.026824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:46.027589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:46.028038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:46.102287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cdfc40ee-7974-499c-8107-3c9f4ae37880 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 23804 microversion: 2.1 time: 0.086800 Nov 09 10:43:46.102937 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 550/1090] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:46 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 23804 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:43:46.211322 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:43:46.211883 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:43:46.212265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:43:46.212696 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:43:46.213087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:43:46.221760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:46.222206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:46.223014 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:46.223448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:46.240631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:43:46.244995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for user e5d350506f684e9da08c4403e84567e4 and project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:43:46.301777 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:43:46.304226 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c88e71b3-9b08-41b4-a885-6a0e8a163a31',volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:43:46.923153 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-110e187f-bbec-4e89-91a6-c8aa4fd12fc5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.203558 Nov 09 10:43:46.928035 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 541/1091] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:43:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:43:46.936224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-aa767949-d670-4cb0-9ffe-ff3dbd6cbb70 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:46.936790 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-aa767949-d670-4cb0-9ffe-ff3dbd6cbb70 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:46.997010 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-aa767949-d670-4cb0-9ffe-ff3dbd6cbb70 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:47.002050 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-aa767949-d670-4cb0-9ffe-ff3dbd6cbb70 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1094 microversion: 2.1 time: 0.070802 Nov 09 10:43:47.002618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 551/1092] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:46 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:43:47.113690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:47.114854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:47.122658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:47.123112 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:47.123928 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:47.124397 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:47.193075 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f3d22133-4274-4868-9baa-69f7336931ee tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 25012 microversion: 2.1 time: 0.082936 Nov 09 10:43:47.197127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 542/1093] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:47 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 25012 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:48.018546 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:48.019170 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:48.025730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:48.026179 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:48.027033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:48.027565 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:48.089611 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:48.097734 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a8c5f52b-c580-4ad8-9a53-3860f05b2a52 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1144 microversion: 2.1 time: 0.082963 Nov 09 10:43:48.101104 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 552/1094] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:48 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:48.206058 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:48.207042 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:48.214564 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:48.215012 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:48.216483 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:48.216929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:48.295338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f161bd5e-f385-4c03-907f-4f4af8568262 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 26550 microversion: 2.1 time: 0.093409 Nov 09 10:43:48.296857 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 543/1095] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:48 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 26550 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:49.118537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:49.119475 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:49.128803 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:49.129424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:49.130409 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:49.131136 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:49.214903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:49.226011 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-00e398e5-dac5-48b0-a764-6c1d01944da7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1210 microversion: 2.1 time: 0.114343 Nov 09 10:43:49.226600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 553/1096] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:49 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:49.307469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:49.308524 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:49.316249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:49.316820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:49.317613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:49.318111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:49.395209 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-994f2c69-012e-4aa0-900a-f44568436fa0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 27563 microversion: 2.1 time: 0.091738 Nov 09 10:43:49.395865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 544/1097] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:49 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 27563 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:50.243220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:50.243830 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:50.250644 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:50.251084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:50.251865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:50.252322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:50.407695 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:50.408861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:50.412212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:50.421562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e63871e2-e146-4a9f-8536-762650f9fee2 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.182184 Nov 09 10:43:50.421828 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:50.422222 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:50.422388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 554/1098] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:50 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:50.423652 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:50.424320 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:50.663418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-db5722ff-b5da-4fe4-9d30-f8fd3ac08b0a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28109 microversion: 2.1 time: 0.259318 Nov 09 10:43:50.664062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 545/1099] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:50 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28109 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:50.833618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e2b0008a-26ef-466a-8856-19c6921e401d req-5819cc90-361a-425f-802e-2049f642b24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d09c948-5d3a-46c1-933b-fa4a6113c27a", "tag": "54c2d8a4-945b-4b08-a2ee-374408f308ec"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:50.835354 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:43:50.835354 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:43:50.844494 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e2b0008a-26ef-466a-8856-19c6921e401d req-5819cc90-361a-425f-802e-2049f642b24f service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:50.847169 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e2b0008a-26ef-466a-8856-19c6921e401d req-5819cc90-361a-425f-802e-2049f642b24f service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:50.858788 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e2b0008a-26ef-466a-8856-19c6921e401d req-5819cc90-361a-425f-802e-2049f642b24f service nova] Creating event network-changed:54c2d8a4-945b-4b08-a2ee-374408f308ec for instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a on hv-cinder-81662 Nov 09 10:43:50.865987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e2b0008a-26ef-466a-8856-19c6921e401d req-5819cc90-361a-425f-802e-2049f642b24f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Nov 09 10:43:50.866453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 555/1100] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:43:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:43:51.447036 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:51.447740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:51.455853 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:51.456328 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:51.457129 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:51.457566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:51.676986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:51.678594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:51.682106 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:51.689320 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:51.689853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:51.690476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3fcb30f1-3e20-49d9-93ba-74dfcfd5e134 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.247552 Nov 09 10:43:51.690779 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:51.691064 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 546/1101] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:51 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:51.691295 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:51.775088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0d59dc92-c93a-46bd-890a-a97a5dbfe033 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28171 microversion: 2.1 time: 0.102833 Nov 09 10:43:51.775893 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 556/1102] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:51 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28171 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:43:52.706823 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:52.707577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:52.714861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:52.715310 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:52.717283 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:52.717283 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:52.788745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:52.789697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:52.796855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:52.797334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:52.798140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:52.798571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:52.855760 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:52.863643 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4650f8ec-c79f-4fc3-971e-23d12c633777 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.160585 Nov 09 10:43:52.864250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 547/1103] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:52 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:52.874948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-04fc3df5-92f9-4d86-81c6-459dc2a778a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28424 microversion: 2.1 time: 0.091076 Nov 09 10:43:52.875600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 557/1104] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:52 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:53.880610 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:53.881219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:53.887838 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:53.888359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:53.889027 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:53.889502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:53.889607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:53.890058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:53.897112 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:53.897558 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:53.898333 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:53.898762 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:53.979299 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-39e2762e-c8fb-49dd-8551-6bc5c10e85b0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28630 microversion: 2.1 time: 0.094050 Nov 09 10:43:53.980237 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 558/1105] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:53 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28630 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:43:54.032895 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:54.040949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c4c5c55b-a90a-457e-9122-99206697e8f7 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.163958 Nov 09 10:43:54.041520 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 548/1106] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:53 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:54.992905 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:54.993899 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:55.001332 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:55.001781 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:55.002551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:55.002987 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:55.058135 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:55.058709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:55.064053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9807840f-d064-4cd6-aab1-6c6595095fdd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28630 microversion: 2.1 time: 0.075364 Nov 09 10:43:55.064975 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 559/1107] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:54 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28630 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:55.067373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:55.067809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:55.068636 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:55.069068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:55.211276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:55.218504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6c774e33-aedb-4339-8b29-9ac852043020 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.164045 Nov 09 10:43:55.219061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 549/1108] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:55 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:43:56.077001 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:56.077997 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:56.085860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:56.086600 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:56.087105 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:56.087540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:56.152446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-04d7d380-4221-437a-902e-29ab067669df tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 28630 microversion: 2.1 time: 0.079762 Nov 09 10:43:56.153564 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 560/1109] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:56 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 28630 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:43:56.235020 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:56.235617 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:56.242158 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:56.242862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:56.243664 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:56.244121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:56.382721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:56.390917 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-626f1b3a-2166-434d-a418-11c5edad2865 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.159607 Nov 09 10:43:56.391476 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 550/1110] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:56 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:57.164718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:57.165743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:57.173601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:57.174041 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:57.174833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:57.175285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:57.253375 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-3a2591ab-c559-4e07-ba78-2d847f681b0e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 29096 microversion: 2.1 time: 0.092229 Nov 09 10:43:57.254379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 561/1111] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:57 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 29096 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:57.407254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:57.407845 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:57.414332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:57.414836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:57.415579 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:57.416040 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:57.567553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:57.575254 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7b559110-1a02-4a13-8a5e-d0adb90be76b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.172286 Nov 09 10:43:57.576817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 551/1112] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:57 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:58.265675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:58.266789 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:58.273816 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:58.274258 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:58.275028 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:58.275455 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:58.356812 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6050ceab-8cfc-423e-85c2-07529ff62b80 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 31094 microversion: 2.1 time: 0.095038 Nov 09 10:43:58.358138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 562/1113] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:58 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 31094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:58.593354 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:58.593932 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:58.600615 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:58.601065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:58.601864 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:58.602300 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:58.739079 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:58.747285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ce13e164-4020-46fd-8469-201622aac25e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.158204 Nov 09 10:43:58.747889 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 552/1114] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:58 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:43:59.371408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:43:59.373095 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:59.381505 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:59.381953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:59.382741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:59.383173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:59.465550 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a118549e-b5a9-4f42-bb4f-58ef00334c57 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 32897 microversion: 2.1 time: 0.099156 Nov 09 10:43:59.466522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 563/1115] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:43:59 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 32897 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:43:59.765327 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:43:59.765950 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:43:59.772472 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:59.775839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:59.775839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:43:59.775839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:43:59.920009 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:43:59.927527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-90872a32-4c5b-4d57-920f-e4843d50e219 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.167089 Nov 09 10:43:59.928152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 553/1116] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:43:59 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:00.478391 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:00.479416 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:00.486896 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:00.496553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:00.496553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:00.496553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:00.571048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-75bb71b7-67d5-4b5f-833c-431a7c99326d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 33833 microversion: 2.1 time: 0.092567 Nov 09 10:44:00.571048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 564/1117] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:00 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 33833 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:00.945335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:00.946067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:00.953736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:00.954349 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:00.955163 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:00.955773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:01.103503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:01.112460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a87de0be-9b7e-4dc4-bc52-dbd5b4841368 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.171501 Nov 09 10:44:01.113067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 554/1118] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:00 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:01.579871 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:01.581009 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:01.588947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:01.589553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:01.590709 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:01.591730 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:01.670959 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-27c78627-cdfb-48be-a90a-2e163152b29b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 34935 microversion: 2.1 time: 0.095442 Nov 09 10:44:01.671633 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 565/1119] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:01 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 34935 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:02.129926 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:02.130576 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:02.137088 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:02.137533 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:02.138898 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:02.139332 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:02.280072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:02.288805 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6b3d196a-645c-4458-829e-0696a9d9cddf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.162477 Nov 09 10:44:02.289446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 555/1120] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:02 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:02.686247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:02.687860 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:02.696518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:02.697030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:02.697865 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:02.698376 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:02.773103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e5b3bd75-2407-49e3-a513-d082fbee1e61 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 36050 microversion: 2.1 time: 0.093495 Nov 09 10:44:02.773751 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 566/1121] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:02 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 36050 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:44:03.157543 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-b9d44ffd-14fe-49ed-8f9b-e290ff28bc7b req-3eefa0dd-f5f9-4af7-8405-e78bdc18777b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c948-5d3a-46c1-933b-fa4a6113c27a", "name": "network-vif-plugged", "status": "completed", "tag": "54c2d8a4-945b-4b08-a2ee-374408f308ec"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:03.160851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:44:03.160851 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:44:03.166811 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-b9d44ffd-14fe-49ed-8f9b-e290ff28bc7b req-3eefa0dd-f5f9-4af7-8405-e78bdc18777b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:03.167256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-b9d44ffd-14fe-49ed-8f9b-e290ff28bc7b req-3eefa0dd-f5f9-4af7-8405-e78bdc18777b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:03.178607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-b9d44ffd-14fe-49ed-8f9b-e290ff28bc7b req-3eefa0dd-f5f9-4af7-8405-e78bdc18777b service nova] Creating event network-vif-plugged:54c2d8a4-945b-4b08-a2ee-374408f308ec for instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a on hv-cinder-81662 Nov 09 10:44:03.183626 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-b9d44ffd-14fe-49ed-8f9b-e290ff28bc7b req-3eefa0dd-f5f9-4af7-8405-e78bdc18777b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030315 Nov 09 10:44:03.184235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 556/1122] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:44:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:44:03.311029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:03.311753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:03.319033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:03.319488 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:03.320315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:03.320753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:03.462706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:03.470998 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2cbae4b-8bea-4735-89a3-e24cc912bc81 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.165637 Nov 09 10:44:03.471653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 567/1123] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:03 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:03.785936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:03.786923 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:03.793024 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:03.793474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:03.794242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:03.794675 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:03.877545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-04361477-0c03-468a-ad66-868b2dbac845 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 37589 microversion: 2.1 time: 0.095286 Nov 09 10:44:03.878101 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 557/1124] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:03 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 37589 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:04.489090 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:04.489718 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:04.496625 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:04.497065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:04.497856 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:04.498285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:04.645698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:04.653107 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-09e12582-93fb-49f5-9963-6c7fcdcc11ba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1266 microversion: 2.1 time: 0.167912 Nov 09 10:44:04.653677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 568/1125] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:04 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:04.890223 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:04.891238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:04.898618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:04.899072 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:04.899875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:04.900461 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:04.986899 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-872adf05-79b4-4f0c-bc64-205bc886e163 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 38157 microversion: 2.1 time: 0.100780 Nov 09 10:44:04.987553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 558/1126] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:04 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 38157 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:44:05.269592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:05.270197 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:05.278670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-928e29c9-17a3-468f-a35e-e18c773367e7 req-b9d3b36f-21b1-4b47-86e8-097270380d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:05.282595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:44:05.282595 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:44:05.285317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.285864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.286741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.287244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.291375 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-928e29c9-17a3-468f-a35e-e18c773367e7 req-b9d3b36f-21b1-4b47-86e8-097270380d9d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.292127 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-928e29c9-17a3-468f-a35e-e18c773367e7 req-b9d3b36f-21b1-4b47-86e8-097270380d9d service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.303422 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-928e29c9-17a3-468f-a35e-e18c773367e7 req-b9d3b36f-21b1-4b47-86e8-097270380d9d service nova] Creating event network-changed:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:44:05.308780 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-928e29c9-17a3-468f-a35e-e18c773367e7 req-b9d3b36f-21b1-4b47-86e8-097270380d9d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033984 Nov 09 10:44:05.309938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 559/1127] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:44:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:44:05.315793 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:44:05.618467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-21cedfee-11c1-4c87-9866-93e933f9abd8 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 204 len: 0 microversion: 2.1 time: 0.352687 Nov 09 10:44:05.619617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 569/1128] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:44:05 2021] DELETE /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:44:05.641671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:05.642026 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:05.649843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.650467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.651438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.652008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.673025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:05.673912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:05.686131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.687187 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.688154 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.689319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.837589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:05.846401 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d77627ea-9a4c-43b8-a675-fb6e2ca903d4 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1453 microversion: 2.1 time: 0.180527 Nov 09 10:44:05.847182 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 570/1129] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:05 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:44:05.863487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:05.863487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:05.871223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.871817 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.872660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:05.873094 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:05.916655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:05.929508 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-431f3e04-e089-4b4f-a06a-eace96fa2d06 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1570 microversion: 2.1 time: 0.293938 Nov 09 10:44:05.940562 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 560/1130] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:05 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1570 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:05.999544 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:06.000690 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:06.006729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:06.007271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:06.042527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:06.042527 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:06.043444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:06.043444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9326c103-adbe-42b1-bc6f-458e730dd802 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1453 microversion: 2.1 time: 0.175621 Nov 09 10:44:06.043444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 571/1131] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:05 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:06.070689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0b846f1d-938e-4986-9a8d-63367c458e87 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 38157 microversion: 2.1 time: 0.075329 Nov 09 10:44:06.072284 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 561/1132] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:05 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 38157 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:44:06.947591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:06.948242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:06.954990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:06.955437 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:06.956239 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:06.956677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:07.084790 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:07.085968 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:07.093870 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:07.094645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:07.095481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:07.095921 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:07.103286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:07.111895 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c3e9f45a-2a3b-44e2-8819-35c60fdcf5b2 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1451 microversion: 2.1 time: 0.167863 Nov 09 10:44:07.112522 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 572/1133] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:06 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:07.172337 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7b238eb3-d79b-49fe-8c66-d608d72d4cd6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 38157 microversion: 2.1 time: 0.092063 Nov 09 10:44:07.173934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 562/1134] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:07 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 38157 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:08.135931 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:08.136723 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:08.145916 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:08.146444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:08.148164 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:08.149196 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:08.191765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:08.196951 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:08.201094 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:08.201557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:08.203364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:08.203794 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:08.232820 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:08.246804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-01d2cebd-394f-4677-ba86-45339b437d98 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1383 microversion: 2.1 time: 0.114645 Nov 09 10:44:08.247665 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 573/1135] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:08 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1383 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:08.252784 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-355d9df9-6f97-4f27-9490-8dd6e127268e req-d4ec71f0-5b84-42eb-939d-c0f12c4c9be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69b3316-b442-4f7a-b46a-5feb9613b807", "name": "network-vif-deleted", "tag": "d38d3818-cbd7-421b-b082-5a11c86acde0"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:08.254575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:44:08.254575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:44:08.263244 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-355d9df9-6f97-4f27-9490-8dd6e127268e req-d4ec71f0-5b84-42eb-939d-c0f12c4c9be2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:08.265660 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-355d9df9-6f97-4f27-9490-8dd6e127268e req-d4ec71f0-5b84-42eb-939d-c0f12c4c9be2 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:08.276733 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-355d9df9-6f97-4f27-9490-8dd6e127268e req-d4ec71f0-5b84-42eb-939d-c0f12c4c9be2 service nova] Creating event network-vif-deleted:d38d3818-cbd7-421b-b082-5a11c86acde0 for instance d69b3316-b442-4f7a-b46a-5feb9613b807 on hv-cinder-81662 Nov 09 10:44:08.283396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6b824e74-2169-4545-b182-6c10a5b6fdb5 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 38171 microversion: 2.1 time: 0.101415 Nov 09 10:44:08.283672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-355d9df9-6f97-4f27-9490-8dd6e127268e req-d4ec71f0-5b84-42eb-939d-c0f12c4c9be2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033544 Nov 09 10:44:08.284113 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 574/1136] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:44:08.285022 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 563/1137] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:08 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 38171 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:09.266234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:09.268800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:09.277337 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.278953 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.280419 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.281083 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.298511 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:09.299582 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:09.307273 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.307724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.308770 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.309378 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.349552 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.350331 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.351158 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lazy-loading 'fault' on Instance uuid d69b3316-b442-4f7a-b46a-5feb9613b807 {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:44:09.391707 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cfa6bb56-711d-4ef4-ab64-fb41699c4710 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 200 len: 38284 microversion: 2.1 time: 0.098073 Nov 09 10:44:09.392512 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 564/1138] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:09 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 38284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:44:09.404579 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:09.405741 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:09.406919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a77eac8a3514e57b3cfea42325759dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af7c886c064b628757c347296afd9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:09.413117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.413572 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.414806 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:09.415263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:09.415572 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8356f128-822b-413a-b4af-fe97eab2b4aa tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 200 len: 1224 microversion: 2.1 time: 0.154006 Nov 09 10:44:09.416173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 575/1139] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:09 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:44:09.443557 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-46e3f35d-55e1-4863-93ad-222191dc2621 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/ips" status: 200 len: 145 microversion: 2.1 time: 0.044320 Nov 09 10:44:09.444473 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 565/1140] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:44:09 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:44:10.299201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-6c1a33cc-0bcf-49f6-b29c-b595be0a15ba req-7fff1ce6-395e-4764-b2b0-1c069cbcdeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d09c948-5d3a-46c1-933b-fa4a6113c27a", "tag": "54c2d8a4-945b-4b08-a2ee-374408f308ec"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:10.301071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:44:10.301071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:44:10.308843 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-6c1a33cc-0bcf-49f6-b29c-b595be0a15ba req-7fff1ce6-395e-4764-b2b0-1c069cbcdeea service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:10.309287 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-6c1a33cc-0bcf-49f6-b29c-b595be0a15ba req-7fff1ce6-395e-4764-b2b0-1c069cbcdeea service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:10.322016 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-6c1a33cc-0bcf-49f6-b29c-b595be0a15ba req-7fff1ce6-395e-4764-b2b0-1c069cbcdeea service nova] Creating event network-changed:54c2d8a4-945b-4b08-a2ee-374408f308ec for instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a on hv-cinder-81662 Nov 09 10:44:10.327891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-6c1a33cc-0bcf-49f6-b29c-b595be0a15ba req-7fff1ce6-395e-4764-b2b0-1c069cbcdeea service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Nov 09 10:44:10.328567 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 576/1141] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:44:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:44:10.433460 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:10.434139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] [instance: d69b3316-b442-4f7a-b46a-5feb9613b807] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:10.442087 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:10.442773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:10.443891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:10.444736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:10.460363 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] HTTP exception thrown: Instance d69b3316-b442-4f7a-b46a-5feb9613b807 could not be found. Nov 09 10:44:10.460975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Returning 404 to user: Instance d69b3316-b442-4f7a-b46a-5feb9613b807 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:44:10.461826 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0eee132a-399b-4cd6-8a15-d4bc0055544e tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807" status: 404 len: 111 microversion: 2.1 time: 0.032384 Nov 09 10:44:10.462390 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 566/1142] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:10 2021] GET /compute/v2.1/servers/d69b3316-b442-4f7a-b46a-5feb9613b807 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:44:10.785033 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-793950cd-a83d-4d87-8f3c-5e4090498eb7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] Calling method '.version_select at 0x7f53dcdfea60>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:10.916388 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-793950cd-a83d-4d87-8f3c-5e4090498eb7 tempest-TestShelveInstance-525211357 tempest-TestShelveInstance-525211357-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1411780037" status: 202 len: 0 microversion: 2.1 time: 0.138124 Nov 09 10:44:10.917569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 577/1143] 10.222.0.35 () {58 vars in 1253 bytes} [Tue Nov 9 10:44:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1411780037 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:44:12.103976 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c57667ab-5b63-4343-93f6-3527e6bfea63"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:12.105043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:12.112750 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:12.113178 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:12.113962 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:12.114393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:13.001716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4d8c2481-5f74-443c-bad9-b4d8a3c97eef tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901215 Nov 09 10:44:13.002485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 567/1144] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:44:12 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:44:20.624467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-772e9566-efad-490e-b38c-3f2f5beeaf4e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:20.638333 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-772e9566-efad-490e-b38c-3f2f5beeaf4e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:20.639813 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-772e9566-efad-490e-b38c-3f2f5beeaf4e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:20.772355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-772e9566-efad-490e-b38c-3f2f5beeaf4e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Going to try to stop instance {{(pid=122672) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 09 10:44:21.178405 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-772e9566-efad-490e-b38c-3f2f5beeaf4e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 202 len: 0 microversion: 2.1 time: 0.562474 Nov 09 10:44:21.182866 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 578/1145] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:20 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:44:21.193413 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:21.194472 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:21.203842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:21.204602 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:21.205637 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:21.206324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:21.365995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:21.376746 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-94dc1fd8-6e65-4cd7-949c-30f2a8319603 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.191655 Nov 09 10:44:21.377489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 568/1146] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:21 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:22.397698 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:22.398739 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:22.408055 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:22.408525 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:22.409366 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:22.409809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:22.575582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:22.584750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-139c0fe5-f7e7-4819-b98b-3a8da8d82278 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.192313 Nov 09 10:44:22.585323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 579/1147] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:22 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:23.602244 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:23.602972 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:23.610316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:23.612590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:23.612590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:23.612590 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:23.770381 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:23.779147 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-daa974fd-2dbb-4b38-a94e-19545155f2a2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.180699 Nov 09 10:44:23.779740 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 569/1148] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:23 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:24.797629 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:24.798247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:24.804976 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:24.805427 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:24.806216 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:24.806650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:24.951710 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:24.959778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5762a72c-89fb-41d7-97a0-601e2fa20003 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.166365 Nov 09 10:44:24.960387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 580/1149] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:24 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:25.977666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:25.978315 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:25.984844 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:25.985291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:25.986077 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:25.986514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:26.123907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:26.132947 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-db4a9140-e51b-471c-96f5-b1e49e4cb9d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.158878 Nov 09 10:44:26.133550 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 570/1150] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:25 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:27.150281 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:27.150886 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:27.157910 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:27.158358 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:27.159140 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:27.159575 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:27.297978 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:27.305952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-63209b44-238f-4308-8d6f-e999fdc55300 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.159472 Nov 09 10:44:27.306519 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 581/1151] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:27 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:28.336445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:28.337195 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:28.344001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:28.344448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:28.345242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:28.346219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:28.488388 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:28.496975 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7f22e77d-6a0a-4a51-9a3b-ededd7342c0f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.164837 Nov 09 10:44:28.497551 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 571/1152] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:28 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:29.514312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:29.514932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:29.521692 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:29.522145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:29.522942 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:29.523382 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:29.667201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:29.676972 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-06645cc2-c73d-44ff-8067-1ceea00ebc6f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.166350 Nov 09 10:44:29.677589 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 582/1153] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:29 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:30.695059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:30.695666 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:30.703531 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:30.704010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:30.704866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:30.705301 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:30.852404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:30.860902 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-53a2d93f-fc4a-4b57-98e0-e5f5256ed074 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1721 microversion: 2.1 time: 0.169861 Nov 09 10:44:30.861469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 572/1154] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:30 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:31.878401 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:31.878995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:31.885327 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:31.885767 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:31.886556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:31.886986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:32.019177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:32.027251 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f56702c5-74d9-42dc-9ab5-3a87ce82d042 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1698 microversion: 2.1 time: 0.153076 Nov 09 10:44:32.027823 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 583/1155] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:31 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:32.043504 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-86cd509c-8880-41ef-ae25-65e8beb88dbd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:44:32.050361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-86cd509c-8880-41ef-ae25-65e8beb88dbd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:32.050799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-86cd509c-8880-41ef-ae25-65e8beb88dbd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:32.112467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-86cd509c-8880-41ef-ae25-65e8beb88dbd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Going to try to start instance {{(pid=122673) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 09 10:44:32.368848 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-86cd509c-8880-41ef-ae25-65e8beb88dbd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 202 len: 0 microversion: 2.1 time: 0.328869 Nov 09 10:44:32.369514 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 573/1156] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:44:32 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:44:32.377928 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:32.378581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:32.384326 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:32.384765 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:32.385532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:32.385965 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:32.535742 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:32.544207 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e8a6a039-a303-4f54-b685-3dc058cfd757 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1707 microversion: 2.1 time: 0.170274 Nov 09 10:44:32.544782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 584/1157] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:32 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:44:33.563480 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:33.564228 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:33.571548 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:33.572073 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:33.572843 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:33.573282 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:33.709657 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:33.717655 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-be81d9a3-d066-42d2-aa10-37fd205b5923 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1707 microversion: 2.1 time: 0.159382 Nov 09 10:44:33.718216 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 574/1158] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:33 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:44:34.735410 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:44:34.736040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:44:34.742642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:34.743079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:34.743837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:44:34.744286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:44:34.872957 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:44:34.881960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b45bcd74-9f6a-4cdc-9962-b39f046222b2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1711 microversion: 2.1 time: 0.150520 Nov 09 10:44:34.882533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 585/1159] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:44:34 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:07.317502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:07.318116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:07.324563 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:07.325015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:07.325794 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:07.326233 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:07.403367 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lazy-loading 'services' on Instance uuid f79e42b6-2d89-4922-9eff-c5e72f4b44fb {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:45:07.677665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-025f31b0-ed09-4524-a124-321bda7282bd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments/c57667ab-5b63-4343-93f6-3527e6bfea63" status: 202 len: 0 microversion: 2.1 time: 0.364386 Nov 09 10:45:07.678313 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 575/1160] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:45:07 2021] DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments/c57667ab-5b63-4343-93f6-3527e6bfea63 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:45:08.784620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fcdaaead-e602-4f91-a484-492ecc181501 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:45:08.790944 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcdaaead-e602-4f91-a484-492ecc181501 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:08.791386 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fcdaaead-e602-4f91-a484-492ecc181501 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:08.813268 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fcdaaead-e602-4f91-a484-492ecc181501 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Going to try to stop instance {{(pid=122672) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 09 10:45:09.001818 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fcdaaead-e602-4f91-a484-492ecc181501 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 202 len: 0 microversion: 2.1 time: 0.221621 Nov 09 10:45:09.002422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 586/1161] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:45:08 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:45:09.011360 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:09.012236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:09.019499 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:09.020128 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:09.021025 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:09.021564 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:09.159181 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:09.166937 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1dc0a0ac-0eec-47af-afb2-55ac1489fa1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.160000 Nov 09 10:45:09.167830 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 576/1162] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:09 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:10.185072 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:10.185768 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:10.192384 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:10.192833 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:10.193605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:10.194035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:10.328815 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:10.336754 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-58750f03-f9ed-4df1-98d2-7b07f6ea4c7f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.155683 Nov 09 10:45:10.337317 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 587/1163] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:10 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:11.354449 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:11.355116 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:11.361151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:11.361593 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:11.362396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:11.362855 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:11.490336 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:11.497856 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b0b5006e-4085-4404-a455-8d177354ea67 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.147122 Nov 09 10:45:11.498444 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 577/1164] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:11 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:12.515136 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:12.515774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:12.522256 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:12.528453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:12.528453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:12.528453 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:12.656891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:12.664930 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1aeb0e6c-d116-44f6-b40b-176964611108 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.153788 Nov 09 10:45:12.665509 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 588/1165] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:12 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:13.683312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:13.683929 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:13.691206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:13.691651 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:13.692459 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:13.692893 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:13.830224 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:13.839345 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-af151a5a-dc3a-4f95-8d18-90250420f21b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.160086 Nov 09 10:45:13.840066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 578/1166] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:13 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:14.857618 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:14.858215 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:14.865253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:14.865956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:14.866749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:14.867191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:14.999746 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:15.007323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a4e3e375-f1cb-4025-8ad7-6e51484d8d1f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.153390 Nov 09 10:45:15.007891 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 589/1167] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:14 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:16.023452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:16.024149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:16.030570 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:16.031022 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:16.031802 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:16.032263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:16.169431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:16.179303 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2bc28a6b-5c5e-4618-8a5a-b43fda6ee151 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.159289 Nov 09 10:45:16.180258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 579/1168] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:16 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:17.197657 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:17.198332 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:17.205829 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:17.206318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:17.207160 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:17.207593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:17.366900 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:17.374586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-8e9cc75e-39ff-4688-92bf-6f58406f67c8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.180587 Nov 09 10:45:17.375157 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 590/1169] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:17 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:18.396309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:18.396920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:18.404528 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:18.404982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:18.405920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:18.406381 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:18.743836 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:18.753736 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-846324cb-3198-42c2-bb0e-d48ad5ccec78 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1675 microversion: 2.1 time: 0.361575 Nov 09 10:45:18.754316 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 580/1170] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:18 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1675 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:19.774971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:19.789220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:19.789220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:19.789220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:19.789220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:19.790066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:20.025012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:20.032802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d5ef45c6-ff76-4bb6-bbb6-0c7ea0d386c4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1652 microversion: 2.1 time: 0.265091 Nov 09 10:45:20.033385 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 591/1171] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:19 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1652 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:20.051187 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9bd2f6d6-8e1a-4d86-ac3e-ff6869d6200c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:45:20.057765 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9bd2f6d6-8e1a-4d86-ac3e-ff6869d6200c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:20.058000 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9bd2f6d6-8e1a-4d86-ac3e-ff6869d6200c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:20.082489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9bd2f6d6-8e1a-4d86-ac3e-ff6869d6200c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Going to try to start instance {{(pid=122673) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 09 10:45:20.242958 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9bd2f6d6-8e1a-4d86-ac3e-ff6869d6200c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action" status: 202 len: 0 microversion: 2.1 time: 0.196342 Nov 09 10:45:20.243588 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 581/1172] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:45:20 2021] POST /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 09 10:45:20.252363 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:20.252995 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:20.258983 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:20.259444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:20.260274 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:20.260713 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:20.404493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:20.412257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2d5cb71-22cc-4cb6-832b-b7ff81b1ff77 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1661 microversion: 2.1 time: 0.164227 Nov 09 10:45:20.421365 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 592/1173] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:20 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1661 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:21.430607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:21.431312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:21.437764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:21.438219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:21.438997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:21.439433 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:21.577076 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:21.585309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-39f9de4b-37d8-4286-bfdf-08c03a94a406 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1661 microversion: 2.1 time: 0.159467 Nov 09 10:45:21.589758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 582/1174] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:21 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:21.696053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:45:21.696498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:45:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:45:22.604420 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:22.604952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:22.611378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:22.611825 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:22.612632 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:22.613069 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:22.742996 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:22.750246 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-44bc15ef-470b-4c3f-8735-9f42facdd1fa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1665 microversion: 2.1 time: 0.149599 Nov 09 10:45:22.750799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 593/1175] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:22 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:50.089936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-387694470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262482173", "security_groups": [{"name": "tempest-secgroup-smoke-1418179760"}], "block_device_mapping_v2": [{"uuid": "22a156b5-8bbc-48c1-83ed-3b8dd6394657", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9ec3b3d-16d6-42bb-8661-ba5a7b86073a"}]}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:45:50.197155 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.network.neutron [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] validate_networks() for [('d9ec3b3d-16d6-42bb-8661-ba5a7b86073a', None, None, None, None, None)] {{(pid=122673) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:45:50.575119 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:45:50.575575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image limits 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:45:50.576105 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Flavor pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:45:50.576518 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Image pref 0:0:0 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:45:50.576920 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.virt.hardware [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:45:50.586416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:50.586873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:50.587727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:50.588238 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:50.605062 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:45:50.609913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Getting quotas for user e5d350506f684e9da08c4403e84567e4 and project f193ff8d94534794ba21cabcf0169326. Resources: {'cores', 'instances', 'ram'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:45:50.665704 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Going to run 1 instances... {{(pid=122673) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:45:50.668384 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22a156b5-8bbc-48c1-83ed-3b8dd6394657',volume_size=None,volume_type=None)] {{(pid=122673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:45:51.227778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-aad79c42-f711-4559-bda9-634318a7f023 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.142179 Nov 09 10:45:51.236755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 583/1176] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:45:50 2021] POST /compute/v2.1/servers => generated 406 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:45:51.239487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7deb215f-bec6-4a1c-ada7-b6eb9a848f89 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:51.240577 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7deb215f-bec6-4a1c-ada7-b6eb9a848f89 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:51.294806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-7deb215f-bec6-4a1c-ada7-b6eb9a848f89 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:51.301286 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7deb215f-bec6-4a1c-ada7-b6eb9a848f89 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1094 microversion: 2.1 time: 0.065779 Nov 09 10:45:51.301956 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 594/1177] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:51 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:52.317809 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:52.318424 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:52.325130 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:52.328288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:52.328288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:52.328288 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:52.386820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:52.394609 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-74f5415d-75b0-414a-b92b-ad8b85a0e902 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1144 microversion: 2.1 time: 0.080921 Nov 09 10:45:52.395440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 584/1178] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:52 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:53.412413 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:53.413213 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:53.419947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:53.420427 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:53.421209 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:53.421640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:53.488684 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:53.494433 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e66cd714-2587-41a9-8c8a-ed0dee85c085 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1210 microversion: 2.1 time: 0.085769 Nov 09 10:45:53.495503 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 595/1179] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:53 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:54.511986 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:54.512641 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:54.518854 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:54.520545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:54.520545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:54.520545 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:54.690709 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:54.698992 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-989d793a-6f96-4582-a3d8-e0688bfb7b73 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1278 microversion: 2.1 time: 0.191302 Nov 09 10:45:54.699566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 585/1180] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:54 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:55.193954 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-b888dc0d-74a2-4aec-8086-6b0cf35f0b0d req-cfaa2036-35fc-4325-94c6-31f8becf83fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9c2589-c6e3-4bd4-baa4-8b6468833d24", "tag": "3cb3b733-a4e3-4ecc-ab21-52dde689f09a"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:45:55.195533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:45:55.195533 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:45:55.202807 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-b888dc0d-74a2-4aec-8086-6b0cf35f0b0d req-cfaa2036-35fc-4325-94c6-31f8becf83fa service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.203259 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-b888dc0d-74a2-4aec-8086-6b0cf35f0b0d req-cfaa2036-35fc-4325-94c6-31f8becf83fa service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.214601 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-b888dc0d-74a2-4aec-8086-6b0cf35f0b0d req-cfaa2036-35fc-4325-94c6-31f8becf83fa service nova] Creating event network-changed:3cb3b733-a4e3-4ecc-ab21-52dde689f09a for instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 on hv-cinder-81662 Nov 09 10:45:55.219594 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-b888dc0d-74a2-4aec-8086-6b0cf35f0b0d req-cfaa2036-35fc-4325-94c6-31f8becf83fa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107581 Nov 09 10:45:55.220291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 596/1181] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:45:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:45:55.721665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:55.721665 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:55.722702 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.723229 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.723919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.724429 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.740986 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:55.741994 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:55.757035 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.762038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.762038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.762038 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.789749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a3bcb22d-66c0-4436-806a-a7ba2d571955 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053256 Nov 09 10:45:55.790319 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 597/1182] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:45:55 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:45:55.846215 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:55.846712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:55.852712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.855569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.855569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:55.855569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:55.879025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:45:55.900145 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:55.916613 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-720baa6f-24d9-4386-8f03-88c359c41e42 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.204557 Nov 09 10:45:55.917204 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 586/1183] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:55 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:56.198233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1864de59-97d9-47dc-90f7-796b99e239f9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 204 len: 0 microversion: 2.1 time: 0.354813 Nov 09 10:45:56.198932 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 598/1184] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:45:55 2021] DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 09 10:45:56.207305 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:56.207918 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:56.214693 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:56.215141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:56.215919 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:56.216374 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:56.463261 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:56.470748 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f98eafd4-3996-40e9-a209-fcf14ce8c8e2 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1671 microversion: 2.1 time: 0.267212 Nov 09 10:45:56.471340 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 587/1185] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:56 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1671 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:56.985484 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:56.986185 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:56.992355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:56.992793 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:56.993556 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:56.994136 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:57.125024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:57.132421 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d33c0c1a-5579-4593-ba54-49578521fb46 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.202531 Nov 09 10:45:57.132980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 599/1186] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:56 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:57.487935 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:57.488561 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:57.495103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:57.495553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:57.496356 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:57.496792 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:57.629861 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:57.637890 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3e569853-8843-4dcf-98a8-1cf9a033283f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1671 microversion: 2.1 time: 0.153731 Nov 09 10:45:57.638462 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 588/1187] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:57 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:58.148784 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:58.149396 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:58.156387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:58.156836 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:58.157606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:58.158042 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:58.293270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:58.300669 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-176af9fc-d240-4c8e-955f-d6140827dc08 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.155515 Nov 09 10:45:58.301435 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 600/1188] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:58 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:58.654759 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:58.656446 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:58.664250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:58.664698 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:58.665481 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:58.665915 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:58.848584 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:58.856394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-2c9a1333-deb1-430f-8d0e-cc6dd6fb1d30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1671 microversion: 2.1 time: 0.205636 Nov 09 10:45:58.859769 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 589/1189] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:58 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:59.227276 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-e247cd76-23a6-43ab-b86e-6f5aea2517db req-0b2a21c1-ed90-42f3-80f0-fe0931a290d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79e42b6-2d89-4922-9eff-c5e72f4b44fb", "name": "network-vif-deleted", "tag": "d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:45:59.232037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:45:59.232037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:45:59.236855 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e247cd76-23a6-43ab-b86e-6f5aea2517db req-0b2a21c1-ed90-42f3-80f0-fe0931a290d8 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.237278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-e247cd76-23a6-43ab-b86e-6f5aea2517db req-0b2a21c1-ed90-42f3-80f0-fe0931a290d8 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.249123 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-e247cd76-23a6-43ab-b86e-6f5aea2517db req-0b2a21c1-ed90-42f3-80f0-fe0931a290d8 service nova] Creating event network-vif-deleted:d9ab7c1a-8c7d-49d1-a42e-120fbe4f3610 for instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb on hv-cinder-81662 Nov 09 10:45:59.254279 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-e247cd76-23a6-43ab-b86e-6f5aea2517db req-0b2a21c1-ed90-42f3-80f0-fe0931a290d8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030607 Nov 09 10:45:59.260593 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 601/1190] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:45:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:45:59.317407 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:59.317946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:59.324309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.324764 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.325773 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.326219 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.473999 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:59.482285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f6865aa7-92af-436f-a1da-8d24e65184cd tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.168625 Nov 09 10:45:59.482872 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 590/1191] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:59 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:45:59.874537 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:45:59.875242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:45:59.881904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.882404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.883194 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.883700 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.920132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:45:59.920551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:45:59.921003 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.objects.instance [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lazy-loading 'fault' on Instance uuid f79e42b6-2d89-4922-9eff-c5e72f4b44fb {{(pid=122672) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:45:59.967021 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:45:59.975634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b67a5b17-2bba-481d-90db-3327fe93e4d9 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 200 len: 1325 microversion: 2.1 time: 0.105880 Nov 09 10:45:59.976612 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 602/1192] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:45:59 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:00.499670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:00.500318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:00.506510 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:00.506954 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:00.507724 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:00.508193 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:00.650822 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:00.658950 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1add8c5c-220a-4f7c-9805-192b2f75e1b0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.163536 Nov 09 10:46:00.659530 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 591/1193] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:00 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:00.992736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:00.993352 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:00.999800 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:01.000302 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:01.001084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:01.001521 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:01.016840 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. Nov 09 10:46:01.017540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:46:01.019024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-847c3263-9d8e-467f-9ed5-35a79a3a4e64 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 404 len: 111 microversion: 2.1 time: 0.030010 Nov 09 10:46:01.019809 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 603/1194] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:00 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:46:01.028995 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-20e36c91-2d60-436f-8957-5ac8852dbc81 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '.version_select at 0x7f53dd73d0d0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:01.032274 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20e36c91-2d60-436f-8957-5ac8852dbc81 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [733b0e4b-8861-4d75-8196-f28d372898a7] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 09 10:46:01.677615 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:01.678225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:01.684447 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:01.684892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:01.685672 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:01.686111 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:01.821091 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:01.829024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c1c8d09d-e9a4-4699-9b93-72ec0174380b tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.156199 Nov 09 10:46:01.829582 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 604/1195] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:01 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:46:02.049361 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [None req-20e36c91-2d60-436f-8957-5ac8852dbc81 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [733b0e4b-8861-4d75-8196-f28d372898a7] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 35736. Nov 09 10:46:02.118105 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-20e36c91-2d60-436f-8957-5ac8852dbc81 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163991950" status: 202 len: 0 microversion: 2.1 time: 1.093560 Nov 09 10:46:02.118686 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 592/1196] 10.222.0.35 () {58 vars in 1217 bytes} [Tue Nov 9 10:46:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163991950 => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:46:02.846487 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:02.847192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:02.857051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:02.857051 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:02.857562 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:02.857850 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:02.972350 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: .version_select at 0x7f53dd82e700>, body: {"keypair": {"name": "tempest-keypair-476151321"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:02.987763 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:46:02.991907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:46:03.002569 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:03.011870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-665679ed-3e01-4ebb-8e93-565006736ae5 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.169223 Nov 09 10:46:03.012670 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 605/1197] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:02 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:03.253949 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:46:03.257796 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.quota [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'key_pairs'} {{(pid=122673) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:46:03.271271 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-efbc7851-fc2e-4f67-8a8a-5048f7817fbb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.302494 Nov 09 10:46:03.272045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 593/1198] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Nov 9 10:46:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:46:04.029330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:04.029948 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:04.036300 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:04.036753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:04.037529 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:04.038000 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:04.172501 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:04.180203 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f39f0f0f-2bec-408b-bc09-056c35beb5bf tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.155095 Nov 09 10:46:04.180782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 606/1199] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:04 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:05.197552 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:05.198250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:05.204043 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:05.204494 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:05.205278 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:05.205711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:05.387037 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:05.394489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6ac9cb8e-cab8-48b9-93c1-5e3fdebb275f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.201091 Nov 09 10:46:05.395066 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 594/1200] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:05 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:05.491270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1200758917", "imageRef": "86bfe38e-6dc3-4159-be24-a8fd5b9e3268", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "230c91f7-84e9-4100-91e5-845eeb203ee8"}], "security_groups": [{"name": "tempest-securitygroup--867211311"}], "key_name": "tempest-keypair-476151321", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:05.590378 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.network.neutron [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] validate_networks() for [('230c91f7-84e9-4100-91e5-845eeb203ee8', None, None, None, None, None)] {{(pid=122672) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 09 10:46:05.929445 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-334ff858-9e1c-40e1-b738-2386f22f5111 req-29295c79-0a5f-43ba-a358-b2f59c87c978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9c2589-c6e3-4bd4-baa4-8b6468833d24", "name": "network-vif-plugged", "status": "completed", "tag": "3cb3b733-a4e3-4ecc-ab21-52dde689f09a"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:05.930888 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:46:05.930888 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:46:05.938372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-334ff858-9e1c-40e1-b738-2386f22f5111 req-29295c79-0a5f-43ba-a358-b2f59c87c978 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:05.938814 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-334ff858-9e1c-40e1-b738-2386f22f5111 req-29295c79-0a5f-43ba-a358-b2f59c87c978 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:05.950739 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-334ff858-9e1c-40e1-b738-2386f22f5111 req-29295c79-0a5f-43ba-a358-b2f59c87c978 service nova] Creating event network-vif-plugged:3cb3b733-a4e3-4ecc-ab21-52dde689f09a for instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 on hv-cinder-81662 Nov 09 10:46:05.955901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-334ff858-9e1c-40e1-b738-2386f22f5111 req-29295c79-0a5f-43ba-a358-b2f59c87c978 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031153 Nov 09 10:46:05.956521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 595/1201] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:46:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:46:06.023176 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Flavor limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 09 10:46:06.023595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Image limits 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 09 10:46:06.024106 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Flavor pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 09 10:46:06.024511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Image pref 0:0:0 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 09 10:46:06.024916 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.virt.hardware [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122672) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 09 10:46:06.034224 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:06.034753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:06.035634 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:06.036204 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:06.053452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 09 10:46:06.057392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.quota [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Getting quotas for user b21b127820fa46358d9054bb65426f0d and project 6592fbeeeebb4270b2c5fbd99522ccae. Resources: {'cores', 'instances', 'ram'} {{(pid=122672) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 09 10:46:06.068424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Going to run 1 instances... {{(pid=122672) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 09 10:46:06.070747 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bfe38e-6dc3-4159-be24-a8fd5b9e3268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122672) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 09 10:46:06.228605 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a58ea423-5c4c-4503-83ff-3904b40d0de7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.741576 Nov 09 10:46:06.229257 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 607/1202] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Nov 9 10:46:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 09 10:46:06.240269 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6e232f8b-b9a8-4b58-ba89-dbaa80bb499a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:06.241065 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6e232f8b-b9a8-4b58-ba89-dbaa80bb499a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:06.299833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6e232f8b-b9a8-4b58-ba89-dbaa80bb499a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:06.306242 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6e232f8b-b9a8-4b58-ba89-dbaa80bb499a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1237 microversion: 2.1 time: 0.070393 Nov 09 10:46:06.312015 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 596/1203] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:06 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:46:06.417127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:06.417736 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:06.423872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:06.424374 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:06.425138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:06.425579 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:06.565659 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:06.573220 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e5e46f75-6191-4cc5-a352-311d93d3f511 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1266 microversion: 2.1 time: 0.159744 Nov 09 10:46:06.573782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 608/1204] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:06 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:07.323115 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:07.323830 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:07.333379 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.333865 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.334687 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.335120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.399566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:07.407785 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4f640eda-797a-44ce-b483-f2030bfdfeaa tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1241 microversion: 2.1 time: 0.088574 Nov 09 10:46:07.408379 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 597/1205] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:07 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:07.589960 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:07.590647 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:07.597740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.598192 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.598966 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.599397 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.735235 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:07.743049 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-be21c58a-72d3-45e3-b7ee-f3fa8e2b3822 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1452 microversion: 2.1 time: 0.156816 Nov 09 10:46:07.743622 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 609/1206] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:07 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:07.759842 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:07.760500 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:07.767085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.767541 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.768364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:07.768810 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:07.901448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:07.908834 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-1187c53c-e762-4430-8d98-01c5f65a782f tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1452 microversion: 2.1 time: 0.152866 Nov 09 10:46:07.909416 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 598/1207] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:07 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:08.425057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:08.425697 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:08.432066 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:08.432559 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:08.433341 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:08.433771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:08.500087 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:08.507626 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6c518513-d4d8-4011-8d71-beb4ede8b241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1307 microversion: 2.1 time: 0.086248 Nov 09 10:46:08.508225 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 610/1208] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:08 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:09.525280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:09.525832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:09.532878 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:09.533727 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:09.534513 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:09.535146 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:10.110897 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:10.118547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-83657266-3910-411e-9676-853ddf9a85d4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.597124 Nov 09 10:46:10.119208 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 599/1209] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:09 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:11.111036 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-1f28432d-8a88-4862-bdf5-ff39db075609 req-2152331c-aefc-4375-93a5-9e2b51d87225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9c2589-c6e3-4bd4-baa4-8b6468833d24", "tag": "3cb3b733-a4e3-4ecc-ab21-52dde689f09a"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:11.112636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:46:11.112636 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:46:11.120774 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-1f28432d-8a88-4862-bdf5-ff39db075609 req-2152331c-aefc-4375-93a5-9e2b51d87225 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:11.121247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-1f28432d-8a88-4862-bdf5-ff39db075609 req-2152331c-aefc-4375-93a5-9e2b51d87225 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:11.133398 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-1f28432d-8a88-4862-bdf5-ff39db075609 req-2152331c-aefc-4375-93a5-9e2b51d87225 service nova] Creating event network-changed:3cb3b733-a4e3-4ecc-ab21-52dde689f09a for instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 on hv-cinder-81662 Nov 09 10:46:11.134791 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:11.135412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:11.140246 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-1f28432d-8a88-4862-bdf5-ff39db075609 req-2152331c-aefc-4375-93a5-9e2b51d87225 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032808 Nov 09 10:46:11.141370 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 611/1210] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:46:11.143279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:11.143733 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:11.144575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:11.145010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:11.369982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:11.380517 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0f8dea72-421e-41f0-a6fa-0c249a832ab8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.247649 Nov 09 10:46:11.382953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 600/1211] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:11 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:12.399395 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:12.400175 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:12.407074 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:12.407554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:12.408360 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:12.408794 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:12.543122 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:12.550947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-536a541c-cdb2-485e-ac31-2a0e61d6a387 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.156034 Nov 09 10:46:12.551511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 612/1212] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:12 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:13.163140 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-08d9087e-f08d-47b9-8bc9-8020440fa73b req-9b272244-5459-4104-abdb-fb363fcfb421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364aeccf-05e4-4aef-84e7-0d23df5aa6ca", "tag": "65406503-4052-4d7c-a0b7-d0c44b26442d"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:13.164691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:46:13.164691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:46:13.172205 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-08d9087e-f08d-47b9-8bc9-8020440fa73b req-9b272244-5459-4104-abdb-fb363fcfb421 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:13.172653 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-08d9087e-f08d-47b9-8bc9-8020440fa73b req-9b272244-5459-4104-abdb-fb363fcfb421 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:13.183171 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-08d9087e-f08d-47b9-8bc9-8020440fa73b req-9b272244-5459-4104-abdb-fb363fcfb421 service nova] Creating event network-changed:65406503-4052-4d7c-a0b7-d0c44b26442d for instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca on hv-cinder-81662 Nov 09 10:46:13.188498 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-08d9087e-f08d-47b9-8bc9-8020440fa73b req-9b272244-5459-4104-abdb-fb363fcfb421 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028968 Nov 09 10:46:13.189082 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 601/1213] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:46:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:46:13.567444 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:13.568132 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:13.574524 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:13.574971 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:13.575771 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:13.576297 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:13.762367 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:13.769620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f4667ddd-8aff-4acc-b869-f5e230827265 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.205881 Nov 09 10:46:13.770180 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 613/1214] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:13 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:14.790907 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:14.792070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:14.800574 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:14.801029 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:14.801825 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:14.802265 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:14.936757 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:14.944191 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-f7a88c99-d948-49e5-891c-0c5ba4b167e7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.160978 Nov 09 10:46:14.950063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 602/1215] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:14 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:15.961404 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:15.961952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:15.968796 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:15.969247 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:15.970056 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:15.970483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:16.106159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:16.113608 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-bfaa96f1-2e72-4305-93e1-51a36976079e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.156432 Nov 09 10:46:16.114177 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 614/1216] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:15 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:17.131154 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:17.131769 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:17.138965 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:17.139407 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:17.140221 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:17.140662 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:17.274412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:17.282260 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-871d827f-0163-4a98-9cb2-89d1fa60f37f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.154920 Nov 09 10:46:17.282823 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 603/1217] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:17 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:18.001473 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-351a1844-83cc-4df4-aef9-57fe1511432a req-c7756ffc-dcd9-4de8-b1cd-25d044f97e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364aeccf-05e4-4aef-84e7-0d23df5aa6ca", "name": "network-vif-plugged", "status": "completed", "tag": "65406503-4052-4d7c-a0b7-d0c44b26442d"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:18.003070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:46:18.003070 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:46:18.010583 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-351a1844-83cc-4df4-aef9-57fe1511432a req-c7756ffc-dcd9-4de8-b1cd-25d044f97e5e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:18.011079 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-351a1844-83cc-4df4-aef9-57fe1511432a req-c7756ffc-dcd9-4de8-b1cd-25d044f97e5e service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:18.021904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-351a1844-83cc-4df4-aef9-57fe1511432a req-c7756ffc-dcd9-4de8-b1cd-25d044f97e5e service nova] Creating event network-vif-plugged:65406503-4052-4d7c-a0b7-d0c44b26442d for instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca on hv-cinder-81662 Nov 09 10:46:18.027057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-351a1844-83cc-4df4-aef9-57fe1511432a req-c7756ffc-dcd9-4de8-b1cd-25d044f97e5e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Nov 09 10:46:18.032284 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 615/1218] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:46:18.298438 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:18.299070 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:18.306107 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:18.308412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:18.308412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:18.308412 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:18.448873 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:18.455470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-639f4263-3d6b-41e2-abe1-1f7fffc74137 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.160697 Nov 09 10:46:18.456078 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 604/1219] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:18 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:19.472446 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:19.473138 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:19.479188 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:19.479632 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:19.480417 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:19.480845 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:19.611677 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:19.619449 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-604e264b-dc3d-4a35-a36e-446fc8453ab3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1362 microversion: 2.1 time: 0.151456 Nov 09 10:46:19.620029 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 616/1220] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:19 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:20.636866 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:20.637414 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:20.643946 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:20.644418 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:20.645215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:20.645649 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:20.781670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:46:20.789068 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c76b3833-a9ae-4fc2-a471-8a652dc79817 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1549 microversion: 2.1 time: 0.156021 Nov 09 10:46:20.789634 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 605/1221] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:46:20 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:46:20.805805 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:46:20.806334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:20.813658 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:20.814096 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:20.814883 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:20.815323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:20.897904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-32a8915e-bba6-4a52-8e63-b561356f4a6d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095673 Nov 09 10:46:20.898497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 617/1222] 10.222.0.35 () {58 vars in 1274 bytes} [Tue Nov 9 10:46:20 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:46:22.250013 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:22.251852 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:22.252045 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-c7358cd9-00b5-4578-9407-3c586afe5cf2 req-a8c42a0c-125e-473d-909a-a11d1b04de08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364aeccf-05e4-4aef-84e7-0d23df5aa6ca", "tag": "65406503-4052-4d7c-a0b7-d0c44b26442d"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:22.253402 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:46:22.253402 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:46:22.258945 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:22.259678 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:22.260501 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:22.261073 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-c7358cd9-00b5-4578-9407-3c586afe5cf2 req-a8c42a0c-125e-473d-909a-a11d1b04de08 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:22.261205 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:22.261606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-c7358cd9-00b5-4578-9407-3c586afe5cf2 req-a8c42a0c-125e-473d-909a-a11d1b04de08 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:22.273795 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-c7358cd9-00b5-4578-9407-3c586afe5cf2 req-a8c42a0c-125e-473d-909a-a11d1b04de08 service nova] Creating event network-changed:65406503-4052-4d7c-a0b7-d0c44b26442d for instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca on hv-cinder-81662 Nov 09 10:46:22.279068 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-c7358cd9-00b5-4578-9407-3c586afe5cf2 req-a8c42a0c-125e-473d-909a-a11d1b04de08 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Nov 09 10:46:22.284263 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 618/1223] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:46:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:46:22.332200 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-69d76cba-25e4-4c91-b2ff-3219f5a03f5b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.085958 Nov 09 10:46:22.335852 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 606/1224] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:22 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:23.343990 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:23.344906 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:23.351191 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:23.351631 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:23.352437 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:23.352867 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:23.417117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9dba87cd-b585-4f2b-8724-b5565cdded02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077651 Nov 09 10:46:23.417766 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 619/1225] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:23 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:46:24.429089 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:24.430102 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:24.437846 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:24.438296 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:24.439090 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:24.439529 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:24.497862 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d0553036-d60a-4167-b8de-e2568a9f6850 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.072650 Nov 09 10:46:24.499199 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 607/1226] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:24 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:25.510764 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:25.512131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:25.519857 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:25.520381 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:25.521171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:25.521804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:25.586586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-b6941cd0-df73-4d63-85f8-77309137dc60 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.079794 Nov 09 10:46:25.587254 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 620/1227] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:25 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:26.598289 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:26.599335 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:26.606488 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:26.606940 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:26.607741 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:26.608211 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:26.667093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-11016430-5a91-44fe-82f6-fa254f679179 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.072672 Nov 09 10:46:26.667093 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 608/1228] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:26 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:27.678775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:27.679780 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:27.687637 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:27.688114 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:27.688894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:27.689322 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:27.752253 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-c8be91a1-a21d-4cc7-baab-7fd6c3c81fed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077478 Nov 09 10:46:27.753549 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 621/1229] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:27 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:28.764663 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:28.765670 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:28.772880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:28.773334 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:28.774120 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:28.774556 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:28.837304 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c8397904-9419-488c-b0f7-8facac5bead4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077116 Nov 09 10:46:28.837938 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 609/1230] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:28 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:29.849057 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:29.850053 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:29.857788 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:29.858242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:29.859018 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:29.859448 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:29.919048 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4b41104d-1b77-4f32-b85c-3328ab15d8eb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.073888 Nov 09 10:46:29.920347 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 622/1231] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:29 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:30.931454 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:30.932393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:30.939425 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:30.939869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:30.940691 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:30.941118 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:31.000607 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0cf423d6-3b2f-4226-8a80-db7e751c4d10 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.073291 Nov 09 10:46:31.001235 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 610/1232] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:30 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 09 10:46:32.012619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:32.013617 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:32.021087 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:32.021532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:32.022312 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:32.022743 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:32.086040 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-df794401-a721-46dd-af70-cac18b9b8c02 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077488 Nov 09 10:46:32.086837 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 623/1233] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:32 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:46:33.098121 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:33.099122 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:33.110092 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:33.110656 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:33.111452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:33.111884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:33.184555 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-cd193a3c-ac6d-4446-92e8-6b6209b6b943 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 10893 microversion: 2.1 time: 0.090265 Nov 09 10:46:33.185249 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 611/1234] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:33 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 10893 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:34.197031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:34.198054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:34.207056 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:34.207504 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:34.208328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:34.208777 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:34.284086 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1c934561-70af-4bae-a015-7baf0a7368ff tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 18305 microversion: 2.1 time: 0.091189 Nov 09 10:46:34.284753 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 624/1235] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:34 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 18305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:35.296256 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:35.297263 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:35.304206 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:35.304661 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:35.305442 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:35.305880 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:35.376174 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-0490da29-a2fd-4259-84d8-210c320c1112 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 19133 microversion: 2.1 time: 0.083815 Nov 09 10:46:35.376823 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 612/1236] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:35 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 19133 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:36.387851 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:36.388884 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:36.395745 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:36.396228 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:36.397031 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:36.397452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:36.467318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d02c3bc1-85e7-42ad-a130-9304ef2acbed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 21570 microversion: 2.1 time: 0.083299 Nov 09 10:46:36.468561 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 625/1237] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:36 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 21570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:37.480277 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:37.481292 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:37.489351 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:37.489799 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:37.490592 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:37.491027 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:37.562596 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-963d4ace-79e7-486f-89e2-812b36f4f20a tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 23228 microversion: 2.1 time: 0.086335 Nov 09 10:46:37.563280 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 613/1238] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:37 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 23228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:38.574757 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:38.575740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:38.582725 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:38.583171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:38.583945 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:38.584411 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:38.655037 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-d309024b-f776-439e-b05c-4492f2c175bf tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 24476 microversion: 2.1 time: 0.084066 Nov 09 10:46:38.655606 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 626/1239] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:38 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 24476 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:39.667492 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:39.668532 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:39.676250 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:39.676711 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:39.677515 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:39.677958 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:39.749695 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4eafbdb4-7df2-4730-ad8a-1c65a29fef65 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 26046 microversion: 2.1 time: 0.086059 Nov 09 10:46:39.751050 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 614/1240] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:39 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 26046 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:40.762694 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:40.763722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:40.771422 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:40.772215 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:40.773067 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:40.773546 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:40.852646 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-de07a62c-6f33-44f5-9195-386a0f845a53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 27232 microversion: 2.1 time: 0.093789 Nov 09 10:46:40.853297 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 627/1241] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:40 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 27232 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:41.867005 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:41.868074 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:41.876164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:41.877236 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:41.878085 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:41.878537 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:41.967833 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-74ab4c0f-505e-4c32-8378-a42e9c0e28fd tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 27875 microversion: 2.1 time: 0.105920 Nov 09 10:46:41.968479 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 615/1242] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:41 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 27875 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:42.980291 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:42.981318 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:42.989403 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:42.989847 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:42.990638 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:42.991067 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:43.067250 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-67b9c7c6-bbfd-4e2c-ae57-604594826b1c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28186 microversion: 2.1 time: 0.090947 Nov 09 10:46:43.067898 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 628/1243] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:42 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:44.079747 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:44.080779 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:44.087677 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:44.088164 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:44.088953 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:44.089394 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:44.152364 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4cb0fb2e-9678-4aa9-b032-6c25c07ac9bc tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28186 microversion: 2.1 time: 0.076605 Nov 09 10:46:44.152991 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 616/1244] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:44 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28186 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:45.164901 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:45.165862 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:45.173065 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:45.173517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:45.174314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:45.174750 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:45.255452 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-ba3feb12-11e0-48a9-851f-eeaa33fd9b30 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28477 microversion: 2.1 time: 0.094515 Nov 09 10:46:45.256145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 629/1245] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:45 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28477 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:46.268627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:46.269631 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:46.276558 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:46.277010 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:46.277786 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:46.278252 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:46.358467 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6314e093-6f86-4a60-af26-de17f9795843 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28645 microversion: 2.1 time: 0.094345 Nov 09 10:46:46.359141 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 617/1246] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:46 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28645 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:47.372540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:47.373559 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:47.381288 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:47.381731 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:47.382511 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:47.382947 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:47.448150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6d03d5d0-5f90-4613-a769-01f0596d85cb tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28645 microversion: 2.1 time: 0.079633 Nov 09 10:46:47.449129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 630/1247] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:47 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28645 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:48.459827 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:48.460927 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:48.467787 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:48.468820 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:48.469594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:48.470059 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:48.538000 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-be490292-0e03-4afa-9a2a-e081bf130c13 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28645 microversion: 2.1 time: 0.082066 Nov 09 10:46:48.538671 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 618/1248] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:48 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:49.553864 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:49.555648 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:49.566480 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:49.566919 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:49.567706 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:49.568172 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:49.639187 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-cddb3f1a-ba21-4ff3-8346-ad8f84ceb02c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 28645 microversion: 2.1 time: 0.091421 Nov 09 10:46:49.639870 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 631/1249] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:49 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 28645 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:50.651372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:50.652322 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:50.659279 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:50.659729 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:50.660536 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:50.660970 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:50.741001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-74d0eaa3-4f2b-42fe-85ae-d36ae6e5656d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 29910 microversion: 2.1 time: 0.093592 Nov 09 10:46:50.746869 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 619/1250] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:50 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 29910 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:51.753592 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:51.754613 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:51.761780 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:51.762229 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:51.763012 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:51.763498 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:51.848201 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-78fea067-2bef-4049-bb0a-345fd88df3ec tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 31829 microversion: 2.1 time: 0.098511 Nov 09 10:46:51.848903 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 632/1251] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:51 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 31829 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:52.860778 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:52.861804 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:52.869380 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:52.869832 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:52.870628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:52.871063 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:52.945391 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c77bb0e8-60e8-4199-9882-162e0445474e tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 33026 microversion: 2.1 time: 0.088490 Nov 09 10:46:52.945967 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 620/1252] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:52 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 33026 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:53.958591 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:53.959517 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:53.966518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:53.966964 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:53.967773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:53.968872 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:54.046532 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-20ee65d5-b4b4-4357-b115-440f221db2b4 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 33857 microversion: 2.1 time: 0.091936 Nov 09 10:46:54.047496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 633/1253] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:53 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 33857 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:55.059455 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:55.060553 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:55.068285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:55.068689 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:55.069475 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:55.069913 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:55.142658 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-e7c3c56d-446d-4085-a7cb-c97a178e1c7d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 35153 microversion: 2.1 time: 0.087285 Nov 09 10:46:55.143311 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 621/1254] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:55 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 35153 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:56.155424 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:56.156489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:56.164260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:56.176212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:56.176212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:56.176212 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:56.247058 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-96f23302-b484-4e7c-b641-e59c1d4fc4ae tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 36579 microversion: 2.1 time: 0.095778 Nov 09 10:46:56.247738 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 634/1255] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:56 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 36579 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:46:57.261276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:57.262324 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:57.270268 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:57.270726 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:57.271547 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:57.272017 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:57.352259 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-dc8cc41f-a312-47c4-b314-78763637d6ed tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 37964 microversion: 2.1 time: 0.094925 Nov 09 10:46:57.353007 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 622/1256] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:57 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 37964 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:58.366715 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:58.367759 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:58.375075 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:58.375551 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:58.376371 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:58.376799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:58.451740 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-985024a6-e193-4b88-b420-999674a22cc6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.089623 Nov 09 10:46:58.453280 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 635/1257] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:58 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 38178 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 09 10:46:59.465151 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:46:59.466186 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:46:59.473944 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:59.474396 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:59.475310 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:46:59.475654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:46:59.541918 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-7aaefa29-1e95-4037-8067-06b1f3fceec1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.080672 Nov 09 10:46:59.542601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 623/1258] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:46:59 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 38178 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:47:00.555102 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:00.556127 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:00.563819 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:00.564296 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:00.565103 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:00.565540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:00.632117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6479eee3-9758-45c7-a882-5ca7bb5cf26b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.081002 Nov 09 10:47:00.632804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 636/1259] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:47:00 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 38178 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:47:01.645594 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:01.646627 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:01.654189 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:01.654639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:01.655936 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:01.656404 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:01.731654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-3347c85c-8579-4105-a6a5-2b1dc0baae1d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action" status: 200 len: 38309 microversion: 2.1 time: 0.090415 Nov 09 10:47:01.732342 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 624/1260] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Nov 9 10:47:01 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/action => generated 38309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 09 10:47:01.744088 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:01.744722 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:01.752039 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:01.752493 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:01.753289 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:01.753723 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:01.779598 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9fc3c49f-21b7-4732-8b43-32aecbf7abf3 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/ips" status: 200 len: 147 microversion: 2.1 time: 0.039771 Nov 09 10:47:01.780219 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 637/1261] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Nov 9 10:47:01 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:03.471560 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc258400-39e7-4a4d-b9db-e9e1efdcd9f5"}} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:03.472894 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:03.481000 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:03.481721 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:03.482521 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:03.483320 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:04.293502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-825a331f-14d3-4b76-a324-520172e2dbb8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825979 Nov 09 10:47:04.293502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 625/1262] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:47:03 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:10.516970 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:47:10.517683 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:47:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:47:11.770992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:11.771899 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:11.779030 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:11.779497 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:11.780301 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:11.780832 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:11.811603 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7d32d780-76d5-4021-812c-eb22397aa5de tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Nov 09 10:47:11.812199 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 638/1263] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:47:11 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:11.823618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:11.824291 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:11.831451 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:11.831906 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:11.832758 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:11.833203 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:11.861431 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-30e0c940-c646-430d-8b12-8f130b302e35 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5" status: 200 len: 194 microversion: 2.1 time: 0.042446 Nov 09 10:47:11.862028 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 626/1264] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Nov 9 10:47:11 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:13.430588 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb396fb-5564-419e-ad60-2a4a24a9154c"}} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:13.431650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:13.438863 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:13.439314 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:13.440134 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:13.440581 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:14.381808 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-5c2b08a6-1e8f-4b76-b337-fc81f07b886c tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954909 Nov 09 10:47:14.382327 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 639/1265] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Nov 9 10:47:13 2021] POST /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 194 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:21.850441 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:21.851470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:21.858094 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:21.858575 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:21.859348 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:21.859781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:21.889566 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-158e55e6-dd04-4f27-a2d0-d7a53ce19c9f tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043036 Nov 09 10:47:21.890114 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 627/1266] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:47:21 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:47:22.124653 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:22.125233 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:22.132405 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:22.132853 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:22.133727 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:22.134162 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:22.162912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-0b3c513e-a796-49eb-ad1b-b979995292a8 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5" status: 200 len: 194 microversion: 2.1 time: 0.042443 Nov 09 10:47:22.163489 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 640/1267] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Nov 9 10:47:22 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:22.172884 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:22.173374 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:22.179892 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:22.180435 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:22.181215 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:22.181645 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:22.261754 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lazy-loading 'services' on Instance uuid 364aeccf-05e4-4aef-84e7-0d23df5aa6ca {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:47:22.509197 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-4352e258-9e61-47d4-afca-b2a58794f8b1 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5" status: 202 len: 0 microversion: 2.1 time: 0.339924 Nov 09 10:47:22.509797 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 628/1268] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:47:22 2021] DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/bc258400-39e7-4a4d-b9db-e9e1efdcd9f5 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:47:24.662171 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:24.663126 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:24.669019 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:24.669470 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:24.670242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:24.670681 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:24.700223 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-1ee89890-3228-4799-94cb-a7ca126eab2b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/0cb396fb-5564-419e-ad60-2a4a24a9154c" status: 200 len: 194 microversion: 2.1 time: 0.041702 Nov 09 10:47:24.700824 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 641/1269] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Nov 9 10:47:24 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/0cb396fb-5564-419e-ad60-2a4a24a9154c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:24.711577 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:24.712185 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:24.718247 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:24.718700 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:24.719469 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:24.719903 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:24.800053 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lazy-loading 'services' on Instance uuid 364aeccf-05e4-4aef-84e7-0d23df5aa6ca {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:47:24.977149 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ca415ff0-3673-48ca-9cdb-7c4e3fd348a0 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/0cb396fb-5564-419e-ad60-2a4a24a9154c" status: 202 len: 0 microversion: 2.1 time: 0.269999 Nov 09 10:47:24.978628 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 629/1270] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Nov 9 10:47:24 2021] DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments/0cb396fb-5564-419e-ad60-2a4a24a9154c => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:47:26.125463 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:26.126471 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:26.133330 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.133778 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.134559 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.134992 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.163117 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-9eff92b2-706c-433e-befc-9b54262a04f6 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041516 Nov 09 10:47:26.168373 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 642/1271] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:47:26 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:47:26.270046 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:26.271355 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:26.277443 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.277901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.278687 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.279126 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.308886 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-185c6b12-e80a-4222-98f3-f6f3bfb8d618 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043488 Nov 09 10:47:26.314318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 630/1272] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Nov 9 10:47:26 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 09 10:47:26.367285 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:26.367792 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:26.373702 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.374129 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.374934 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.375355 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.399952 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:47:26.714917 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-083fe745-59a5-4269-947a-9053ee183cc7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 204 len: 0 microversion: 2.1 time: 0.351796 Nov 09 10:47:26.715518 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 643/1273] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:26 2021] DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:47:26.724420 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:26.727428 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:26.731045 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.731493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.732290 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:26.732716 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:26.868831 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:26.876440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-60926634-8351-4768-9723-4018d9aae590 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1674 microversion: 2.1 time: 0.156519 Nov 09 10:47:26.877008 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 631/1274] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:26 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:47:27.894315 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:27.895208 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:27.901574 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:27.902025 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:27.902799 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:27.903234 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:28.035506 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:28.043328 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-30a637c0-4011-4e7e-a397-3af17b3dec53 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1674 microversion: 2.1 time: 0.153081 Nov 09 10:47:28.043892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 644/1275] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:27 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:29.061117 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:29.061732 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:29.068139 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:29.068585 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:29.069352 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:29.069781 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:29.141474 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:29.145812 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-28b34c38-6b23-449e-9589-3b50c508bd59 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1607 microversion: 2.1 time: 0.087832 Nov 09 10:47:29.146395 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 632/1276] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:29 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1607 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:29.513332 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [req-727ada47-84ef-42a9-9f5f-cc2abdcbc386 req-fb55c064-571b-4593-9717-c83e95332d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364aeccf-05e4-4aef-84e7-0d23df5aa6ca", "name": "network-vif-deleted", "tag": "65406503-4052-4d7c-a0b7-d0c44b26442d"}]} {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:29.515270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:47:29.515270 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: warnings.warn(msg) Nov 09 10:47:29.523650 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-727ada47-84ef-42a9-9f5f-cc2abdcbc386 req-fb55c064-571b-4593-9717-c83e95332d2a service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:29.524408 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [req-727ada47-84ef-42a9-9f5f-cc2abdcbc386 req-fb55c064-571b-4593-9717-c83e95332d2a service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:29.541311 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.compute.server_external_events [req-727ada47-84ef-42a9-9f5f-cc2abdcbc386 req-fb55c064-571b-4593-9717-c83e95332d2a service nova] Creating event network-vif-deleted:65406503-4052-4d7c-a0b7-d0c44b26442d for instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca on hv-cinder-81662 Nov 09 10:47:29.547145 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [req-727ada47-84ef-42a9-9f5f-cc2abdcbc386 req-fb55c064-571b-4593-9717-c83e95332d2a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152383 Nov 09 10:47:29.548483 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 645/1277] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:30.163578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:30.164489 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:30.172160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:30.172756 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:30.185522 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:30.186434 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:30.219817 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:30.220618 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:30.221248 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.objects.instance [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lazy-loading 'fault' on Instance uuid 364aeccf-05e4-4aef-84e7-0d23df5aa6ca {{(pid=122673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 09 10:47:30.269485 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21b127820fa46358d9054bb65426f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6592fbeeeebb4270b2c5fbd99522ccae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:30.277262 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-c0f4e829-4eb8-4727-bcd1-55448f250241 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 200 len: 1327 microversion: 2.1 time: 0.118474 Nov 09 10:47:30.277801 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 633/1278] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:30 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:31.295712 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:31.296430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:31.303458 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:31.303894 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:31.304785 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:31.305217 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:31.319215 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. Nov 09 10:47:31.319797 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:31.320642 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-dfc69334-3f40-422a-be03-789cbd596bb7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 404 len: 111 microversion: 2.1 time: 0.028949 Nov 09 10:47:31.321173 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 646/1279] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:31 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:31.329225 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-a7253e42-ff86-4a1b-9762-2600c941a93b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '.version_select at 0x7f53dd8d09d0>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:31.400982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-a7253e42-ff86-4a1b-9762-2600c941a93b tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476151321" status: 202 len: 0 microversion: 2.1 time: 0.075294 Nov 09 10:47:31.401601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 634/1280] 10.222.0.35 () {58 vars in 1217 bytes} [Tue Nov 9 10:47:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476151321 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:47:34.712652 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:34.713150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:34.719502 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:34.719943 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:34.720741 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:34.721166 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:34.734656 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. Nov 09 10:47:34.735242 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:34.736080 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-6e1493dc-75f3-4e3e-8d0f-e2993f840ca7 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 404 len: 111 microversion: 2.1 time: 0.027780 Nov 09 10:47:34.736612 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 647/1281] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:34 2021] DELETE /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:34.746016 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:34.746762 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: 364aeccf-05e4-4aef-84e7-0d23df5aa6ca] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:34.752506 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:34.752948 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:34.753720 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:34.754152 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:34.770839 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. Nov 09 10:47:34.771436 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance 364aeccf-05e4-4aef-84e7-0d23df5aa6ca could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:34.773622 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-b2c08d42-f912-473d-9e0f-d8e26c7c8986 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca" status: 404 len: 111 microversion: 2.1 time: 0.032512 Nov 09 10:47:34.774941 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 635/1282] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:34 2021] GET /compute/v2.1/servers/364aeccf-05e4-4aef-84e7-0d23df5aa6ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:47:36.031892 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:36.032496 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:36.038846 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:36.039392 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:36.040685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:36.041128 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:36.054685 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. Nov 09 10:47:36.055277 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:36.056708 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-27089051-3672-4cf1-84fd-7e9b63c44557 tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 404 len: 111 microversion: 2.1 time: 0.028639 Nov 09 10:47:36.057260 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 648/1283] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:36 2021] DELETE /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:36.065160 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:36.066210 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] [instance: f79e42b6-2d89-4922-9eff-c5e72f4b44fb] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:36.073309 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:36.073994 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:36.075207 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:36.075891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:36.095629 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] HTTP exception thrown: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. Nov 09 10:47:36.099440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] Returning 404 to user: Instance f79e42b6-2d89-4922-9eff-c5e72f4b44fb could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:36.099440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-d64614f3-acaf-4f47-acee-5da82ef95f4d tempest-AttachVolumeTestJSON-1819306428 tempest-AttachVolumeTestJSON-1819306428-project] 10.222.0.35 "GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb" status: 404 len: 111 microversion: 2.1 time: 0.036066 Nov 09 10:47:36.099440 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 636/1284] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:36 2021] GET /compute/v2.1/servers/f79e42b6-2d89-4922-9eff-c5e72f4b44fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:47:40.257078 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:40.257806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:40.260103 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-6c3f8e60-59b4-4f67-a180-290f7dc7127b req-2e761d82-d83b-462b-aa9c-e4f2abfdd0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9c2589-c6e3-4bd4-baa4-8b6468833d24", "tag": "3cb3b733-a4e3-4ecc-ab21-52dde689f09a"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:40.262338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:47:40.262338 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:47:40.265265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:40.265782 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:40.266649 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:40.267195 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:40.269402 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-6c3f8e60-59b4-4f67-a180-290f7dc7127b req-2e761d82-d83b-462b-aa9c-e4f2abfdd0fb service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:40.276285 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-6c3f8e60-59b4-4f67-a180-290f7dc7127b req-2e761d82-d83b-462b-aa9c-e4f2abfdd0fb service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:40.281707 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-6c3f8e60-59b4-4f67-a180-290f7dc7127b req-2e761d82-d83b-462b-aa9c-e4f2abfdd0fb service nova] Creating event network-changed:3cb3b733-a4e3-4ecc-ab21-52dde689f09a for instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 on hv-cinder-81662 Nov 09 10:47:40.287227 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-6c3f8e60-59b4-4f67-a180-290f7dc7127b req-2e761d82-d83b-462b-aa9c-e4f2abfdd0fb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030918 Nov 09 10:47:40.288001 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 637/1285] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:40.294442 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:47:40.599640 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-46548c9a-de4f-4a8d-a7d6-e2706b67ceb0 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "DELETE /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 204 len: 0 microversion: 2.1 time: 0.345947 Nov 09 10:47:40.604379 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 649/1286] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:40 2021] DELETE /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:47:40.609493 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:40.610470 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:40.616901 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:40.617359 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:40.618698 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:40.619318 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:40.797755 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:40.805408 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-6374bbc8-b71f-4035-ba65-7b73a2294c2a tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1577 microversion: 2.1 time: 0.199884 Nov 09 10:47:40.805985 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 638/1287] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:40 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:47:41.823586 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:41.824387 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:41.830607 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:41.831131 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:41.831989 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:41.832467 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:41.970150 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:41.977775 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-4cc5b493-707f-441b-9df7-88cfa39f2523 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1458 microversion: 2.1 time: 0.158872 Nov 09 10:47:41.978338 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 650/1288] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:41 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:42.633633 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-8eb6c88a-965f-4c0c-a48a-845bd75e4088 req-8ae8e47e-a196-468e-a605-5bb5748c7ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9c2589-c6e3-4bd4-baa4-8b6468833d24", "name": "network-vif-deleted", "tag": "3cb3b733-a4e3-4ecc-ab21-52dde689f09a"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:42.635156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:47:42.635156 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:47:42.642766 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-8eb6c88a-965f-4c0c-a48a-845bd75e4088 req-8ae8e47e-a196-468e-a605-5bb5748c7ca9 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:42.643246 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-8eb6c88a-965f-4c0c-a48a-845bd75e4088 req-8ae8e47e-a196-468e-a605-5bb5748c7ca9 service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:42.654876 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-8eb6c88a-965f-4c0c-a48a-845bd75e4088 req-8ae8e47e-a196-468e-a605-5bb5748c7ca9 service nova] Creating event network-vif-deleted:3cb3b733-a4e3-4ecc-ab21-52dde689f09a for instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 on hv-cinder-81662 Nov 09 10:47:42.663353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-8eb6c88a-965f-4c0c-a48a-845bd75e4088 req-8ae8e47e-a196-468e-a605-5bb5748c7ca9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030516 Nov 09 10:47:42.663353 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 639/1289] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:42.995911 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:42.996749 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:43.003393 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:43.004174 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:43.005133 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:43.005671 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:43.115249 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:43.123464 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-f3b9877f-0592-4c45-8fff-340ef6021ebe tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 200 len: 1225 microversion: 2.1 time: 0.132565 Nov 09 10:47:43.134297 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 651/1290] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:42 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:44.142312 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:44.143055 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 0a9c2589-c6e3-4bd4-baa4-8b6468833d24] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:44.149578 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:44.150033 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:44.150818 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:44.151258 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:44.164297 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] HTTP exception thrown: Instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 could not be found. Nov 09 10:47:44.164898 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Returning 404 to user: Instance 0a9c2589-c6e3-4bd4-baa4-8b6468833d24 could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:44.165725 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-9b01da36-8032-4ad2-b872-30a738dfb39e tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24" status: 404 len: 111 microversion: 2.1 time: 0.027658 Nov 09 10:47:44.166276 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 640/1291] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:44 2021] GET /compute/v2.1/servers/0a9c2589-c6e3-4bd4-baa4-8b6468833d24 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 09 10:47:47.770553 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:47.771340 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:47.772414 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-e7692764-f0a8-4712-8c98-a855521258c0 req-e250006d-3393-451f-93c7-08a6de7d9dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d09c948-5d3a-46c1-933b-fa4a6113c27a", "tag": "54c2d8a4-945b-4b08-a2ee-374408f308ec"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:47.773934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:47:47.773934 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:47:47.779595 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:47.780092 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:47.781084 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:47.781719 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:47.781958 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-e7692764-f0a8-4712-8c98-a855521258c0 req-e250006d-3393-451f-93c7-08a6de7d9dee service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:47.782388 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-e7692764-f0a8-4712-8c98-a855521258c0 req-e250006d-3393-451f-93c7-08a6de7d9dee service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:47.796875 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-e7692764-f0a8-4712-8c98-a855521258c0 req-e250006d-3393-451f-93c7-08a6de7d9dee service nova] Creating event network-changed:54c2d8a4-945b-4b08-a2ee-374408f308ec for instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a on hv-cinder-81662 Nov 09 10:47:47.802768 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-e7692764-f0a8-4712-8c98-a855521258c0 req-e250006d-3393-451f-93c7-08a6de7d9dee service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033716 Nov 09 10:47:47.803372 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 641/1292] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 09 10:47:47.810198 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Going to try to terminate instance {{(pid=122672) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 09 10:47:48.179675 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-7aa0e25b-fc21-49f3-b6be-793e0ae1b7f3 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 204 len: 0 microversion: 2.1 time: 0.412902 Nov 09 10:47:48.185579 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 652/1293] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:47 2021] DELETE /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 09 10:47:48.190573 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:48.191452 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:48.198086 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:48.198608 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:48.200448 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:48.200891 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:48.365400 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.policy [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122673) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:48.373614 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-45df8d6d-3a86-486b-9f41-30699e1e6de1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1577 microversion: 2.1 time: 0.187414 Nov 09 10:47:48.380176 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 642/1294] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:48 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 09 10:47:49.398904 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:49.399619 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:49.406571 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:49.407024 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:49.407806 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:49.408269 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:49.557627 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:49.565365 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e6230a07-991d-4a64-b0e2-ea3e31971700 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1459 microversion: 2.1 time: 0.170415 Nov 09 10:47:49.565949 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 653/1295] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:49 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1459 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:50.254990 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [req-80359093-c0e6-45e0-8c71-1ba25f031dc0 req-141938cb-8176-4a52-a55e-63bfb662190b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d09c948-5d3a-46c1-933b-fa4a6113c27a", "name": "network-vif-deleted", "tag": "54c2d8a4-945b-4b08-a2ee-374408f308ec"}]} {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 09 10:47:50.256601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 10:47:50.256601 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: warnings.warn(msg) Nov 09 10:47:50.265067 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-80359093-c0e6-45e0-8c71-1ba25f031dc0 req-141938cb-8176-4a52-a55e-63bfb662190b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:50.265541 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [req-80359093-c0e6-45e0-8c71-1ba25f031dc0 req-141938cb-8176-4a52-a55e-63bfb662190b service nova] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:50.282895 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.compute.server_external_events [req-80359093-c0e6-45e0-8c71-1ba25f031dc0 req-141938cb-8176-4a52-a55e-63bfb662190b service nova] Creating event network-vif-deleted:54c2d8a4-945b-4b08-a2ee-374408f308ec for instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a on hv-cinder-81662 Nov 09 10:47:50.288654 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [req-80359093-c0e6-45e0-8c71-1ba25f031dc0 req-141938cb-8176-4a52-a55e-63bfb662190b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038835 Nov 09 10:47:50.289541 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 643/1296] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Nov 9 10:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 09 10:47:50.582482 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:50.583292 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:50.592338 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:50.592802 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:50.593603 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:50.594047 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:50.661877 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.policy [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d350506f684e9da08c4403e84567e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f193ff8d94534794ba21cabcf0169326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122672) authorize /opt/stack/nova/nova/policy.py:199}} Nov 09 10:47:50.672492 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-a2b5ce5d-7ba3-4b2d-8bf7-33a63bbb5389 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 200 len: 1225 microversion: 2.1 time: 0.093828 Nov 09 10:47:50.682912 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 654/1297] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:50 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 09 10:47:51.690241 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:51.690982 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 7d09c948-5d3a-46c1-933b-fa4a6113c27a] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:51.697158 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:51.700503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:51.700503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:51.700503 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:51.712368 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] HTTP exception thrown: Instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a could not be found. Nov 09 10:47:51.712964 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Returning 404 to user: Instance 7d09c948-5d3a-46c1-933b-fa4a6113c27a could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:51.713825 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-ad43b2c6-dde9-40fc-916b-74f7f8ff47f1 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a" status: 404 len: 111 microversion: 2.1 time: 0.028280 Nov 09 10:47:51.714373 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 644/1298] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:51 2021] GET /compute/v2.1/servers/7d09c948-5d3a-46c1-933b-fa4a6113c27a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:52.268243 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:52.268929 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.compute.api [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122672) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:52.275278 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:52.275728 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:52.276540 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:52.276980 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG oslo_concurrency.lockutils [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122672) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:52.291515 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.wsgi [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] HTTP exception thrown: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. Nov 09 10:47:52.292193 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Returning 404 to user: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. {{(pid=122672) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:52.293071 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-fccbc85b-3635-4f14-a201-0d8003898657 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "DELETE /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 404 len: 111 microversion: 2.1 time: 0.028680 Nov 09 10:47:52.293635 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 655/1299] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Nov 9 10:47:52 2021] DELETE /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:52.302377 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '>' {{(pid=122673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:52.302989 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.compute.api [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] [instance: 770c8a3b-b36d-473c-bf3c-f51f8124875d] Fetching instance by UUID {{(pid=122673) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 09 10:47:52.309541 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:52.310011 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:52.310788 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 09 10:47:52.311217 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG oslo_concurrency.lockutils [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Lock "4342541e-f05b-438e-bfa3-eef56eb5f7a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 09 10:47:52.325538 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.wsgi [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] HTTP exception thrown: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. Nov 09 10:47:52.326130 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: DEBUG nova.api.openstack.wsgi [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Returning 404 to user: Instance 770c8a3b-b36d-473c-bf3c-f51f8124875d could not be found. {{(pid=122673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 09 10:47:52.327298 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO nova.api.openstack.requestlog [None req-fea8da46-bc87-4fcf-ad6b-8ba0ab0ffbba tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d" status: 404 len: 111 microversion: 2.1 time: 0.029007 Nov 09 10:47:52.327534 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: [pid: 122673|app: 0|req: 645/1300] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Nov 9 10:47:52 2021] GET /compute/v2.1/servers/770c8a3b-b36d-473c-bf3c-f51f8124875d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 09 10:47:53.966246 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: DEBUG nova.api.openstack.wsgi [None req-e88f7654-6945-4ecd-ae6d-e80fceeae627 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] Calling method '.version_select at 0x7f53dcee3700>' {{(pid=122672) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 09 10:47:54.103695 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO nova.api.openstack.requestlog [None req-e88f7654-6945-4ecd-ae6d-e80fceeae627 tempest-TestVolumeBootPattern-1102894926 tempest-TestVolumeBootPattern-1102894926-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1262482173" status: 202 len: 0 microversion: 2.1 time: 0.141190 Nov 09 10:47:54.104323 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: [pid: 122672|app: 0|req: 656/1301] 10.222.0.35 () {58 vars in 1262 bytes} [Tue Nov 9 10:47:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1262482173 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 09 10:48:41.713620 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:48:41.714265 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:48:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:48:41.831039 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:48:41.831597 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: Tue Nov 9 10:48:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:50:30.540334 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:50:30.540804 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:50:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:50:39.366395 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:50:39.367054 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:50:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:50:41.799826 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:50:41.800393 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: Tue Nov 9 10:50:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:52:01.731488 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:52:01.732159 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:52:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:52:01.847997 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:52:01.848639 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: Tue Nov 9 10:52:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:52:48.157297 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:52:48.158061 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: Tue Nov 9 10:52:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:53:50.558773 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:53:50.559430 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:53:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:53:59.383554 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:53:59.384321 dv-cinder-816628-1-iscsi devstack@n-api.service[122672]: Tue Nov 9 10:53:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 09 10:54:01.818502 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 09 10:54:01.819111 dv-cinder-816628-1-iscsi devstack@n-api.service[122673]: Tue Nov 9 10:54:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!